ChatGPT解决这个技术问题 Extra ChatGPT

Speed up Spring Boot startup time

I have a Spring Boot application. I've added a lot of dependencies (unfortunately, looks I need all of them) and the startup time went up quite a lot. Just doing a SpringApplication.run(source, args) takes 10 seconds.

While that might not be much compared to what are "used" to, I'm unhappy that it takes that much, mostly because it breaks the development flow. The application itself is rather small at this point, so I assume most of the time is related to the added dependencies, not the app classes themselves.

I assume the issue is classpath scanning, but I am not sure how to:

Confirm that is the issue (i.e. how to "debug" Spring Boot)

If it really is the cause, how can I limit it, so it gets faster? For example, if I know that some dependency or package does not contain anything that Spring should be scanning, is there a way to limit that?

I assume that enhancing Spring to have parallel bean initialization during startup would speed up things, but that enhancement request has been open since 2011, without any progress. I see some other efforts in Spring Boot itself, such as Investigate Tomcat JarScanning speed improvements, but that is Tomcat specific and has been abandoned.

This article:

http://www.nurkiewicz.com/2010/12/speeding-up-spring-integration-tests.html

although aimed at integration tests, suggests using lazy-init=true, however I do not know how to apply this to all beans in Spring Boot using Java configuration - any pointers here?

Any (other) suggestions would be welcome.

Post your code. Normally only the package the application runner is defined is is scanned. If you have other packages defined for @ComponentScan those are scanned as well. Another thing is to make sure you haven't enabled debug or trace logging as generally logging is slow, very slow.
If you use Hibernate it also tends to eat significant time at application start.
Spring's auto binding by type coupled with factory beans has the potential to be slow one you add a lot of beans and dependencies.
Or you can use caching, spring.io/guides/gs/caching
Thanks all for the comments - I would not be able to post the code unfortunately (a lot of internal jars), however I'm still looking for a way to debug this. Yes, I might be using A or B or doing X or Y, which slows it down. How do I determine this? If I add a dependency X, which has 15 transitive dependencies, how do I know which of those 16 slowed it down? If I can find out, is there anything I can do later to stop Spring from examining them? Pointers like that would be useful!

l
luboskrnac

Spring Boot does a lot of auto-configuration that may not be needed. So you may want to narrow down only auto-configuration that is needed for your app. To see full list of auto-configuration included, just run logging of org.springframework.boot.autoconfigure in DEBUG mode (logging.level.org.springframework.boot.autoconfigure=DEBUG in application.properties). Another option is to run spring boot application with --debug option: java -jar myproject-0.0.1-SNAPSHOT.jar --debug

There would be something like this in output:

=========================
AUTO-CONFIGURATION REPORT
=========================

Inspect this list and include only autoconfigurations you need:

@Configuration
@Import({
        DispatcherServletAutoConfiguration.class,
        EmbeddedServletContainerAutoConfiguration.class,
        ErrorMvcAutoConfiguration.class,
        HttpEncodingAutoConfiguration.class,
        HttpMessageConvertersAutoConfiguration.class,
        JacksonAutoConfiguration.class,
        ServerPropertiesAutoConfiguration.class,
        PropertyPlaceholderAutoConfiguration.class,
        ThymeleafAutoConfiguration.class,
        WebMvcAutoConfiguration.class,
        WebSocketAutoConfiguration.class,
})
public class SampleWebUiApplication {

Code was copied from this blog post.


did you measure this ??? Was it much faster?? In my opinion this is an exceptional case, much more important to make sure that Spring test context cache works
@idmitriev I just measured this on my application and my application started up at 53 seconds, compared to without exluding the autoconfiguration classes was 73 seconds. I did exclude many more classes than listed above though.
How to deal with Private configuration classes ?
Is there a way to automatically know which auto-configurations are actually used? Maybe some long-running thing that adds up all auto-configs used throughout the app life-time and then you can poll an actuator endpoint to see that list?
@payne, I am not aware of anything like you are describing.
k
kvantour

The most voted answer so far is not wrong, but it doesn't go into the depth I like to see and provides no scientific evidence. The Spring Boot team went through an exercise for reducing startup time for Boot 2.0, and ticket 11226 contains a lot of useful information. There is also a ticket 7939 open to adding timing information to condition evaluation, but it doesn't seem to have a specific ETA.

The most useful, and methodical approach for debugging Boot startup has been done by Dave Syer. https://github.com/dsyer/spring-boot-startup-bench

I had a similar use case as well, so I took Dave's approach of micro-benchmarking with JMH and ran with it. The result is the boot-benchmark project. I designed it such that it can be used to measure startup time for any Spring Boot application, using the executable jar produced by bootJar (previously called bootRepackage in Boot 1.5) Gradle task. Feel free to use it and provide feedback.

My findings are as follows:

CPU matters. A lot. Starting the JVM with -Xverify:none helps significantly. Excluding unnecessary autoconfigurations helps. Dave recommended JVM argument -XX:TieredStopAtLevel=1, but my tests didn't show significant improvement with that. Also, -XX:TieredStopAtLevel=1 would probably slow down your first request. There have been reports of hostname resolution being slow, but I didn't find it to be a problem for the apps I tested.


It does not seem that your project builds under gradle 4.8.1. Could you share which gradle version you used in your benchmarks?
@user991710 Based on my Gradle wrapper, I'm using v4.6. "Does not build" is a very vague statement, if you've something more specific, create a gist and post the link here. Your gist should list the steps you followed, and the error you're getting.
To add on to this, could you please add an example as to how someone might use your benchmark with a custom application? Does it have to be added as a project similar to minimal, or may the jar simply be supplied? I attempted to do the former but did not get very far.
Don't run -Xverify:none on production as it breaks code verification and you can run into trouble. -XX:TieredStopAtLevel=1 is OK if you run an application for a small duration (a few seconds) otherwise it will be less productive as it will provide the JVM with long running optimizations.
Many pools (Oracle UCP for sure, but in my testing also Hikari and Tomcat) encrypt data in the pool. I actually don't know if they are encrypting the connection info, or wrapping the stream. Regardless, encryption uses random number generation and so having a highly available, high throughput entropy source makes a noticeable difference in performance.
N
Niraj Sonawane

Spring Boot 2.2.M1 has added feature to support Lazy Initialization in Spring Boot.

By default, when an application context is being refreshed, every bean in the context is created and its dependencies are injected. By contrast, when a bean definition is configured to be initialized lazily it will not be created and its dependencies will not be injected until it’s needed.

Enabling Lazy Initialization Set spring.main.lazy-initialization to true

When to Enable Lazy Initialization

lazy initialization can offer significant improvements in start up time but there are some notable downsides too and it’s important to enable it with care

For more details please check Doc

Update:

Spring Boot Spring Boot 2.4.0 - Startup Endpoint

Spring Boot 2.4.0 has added a new Startup endpoint that can be used to identify beans that are taking longer than expected to start. You can get more details about the Application Startup tracking here


if you enable lazy initialization, first time loading is super fast, but when client accessing for the first time it may notice some delay. I really recommend this for the development not for the production.
As @IsuruDewasurendra suggested, it is rightly not a recommended way, it can significantly increase the latency when the app starts serving load.
It just kicks the can down the road.
I use Lazy Initialization only on development because the first access is so lazy, but it is good feature in Spring Boot.
C
Community

As described in this question/answer, I think the best approach is to instead of adding only those you think you need, exclude the dependencies you know you don't need.

See: Minimise Spring Boot Startup Time

In summary:

You can see what is going on under the covers and enable debug logging as simple as specifying --debug when starting the application from the command-line. You can also specify debug=true in your application.properties.

Also, you can set the logging level in application.properties as simple as:

logging.level.org.springframework.web: DEBUG logging.level.org.hibernate: ERROR

If you detect an auto-configured module you don't want, it can be disabled. The docs for this can be found here: http://docs.spring.io/spring-boot/docs/current-SNAPSHOT/reference/htmlsingle/#using-boot-disabling-specific-auto-configuration

An example would look like:

@Configuration
@EnableAutoConfiguration(exclude={DataSourceAutoConfiguration.class})
public class MyConfiguration {
}

P
Przemek Nowak

Well there is entire list of possible actions described here: https://spring.io/blog/2018/12/12/how-fast-is-spring

I will put the most important notes from Spring side (adjusted a little bit):

Classpath exclusions from Spring Boot web starters: Hibernate Validator Jackson (but Spring Boot actuators depend on it). Use Gson if you need JSON rendering (only works with MVC out of the box). Logback: use slf4j-jdk14 instead

Hibernate Validator

Jackson (but Spring Boot actuators depend on it). Use Gson if you need JSON rendering (only works with MVC out of the box).

Logback: use slf4j-jdk14 instead

Use the spring-context-indexer. It’s not going to add much, but every little helps.

Don’t use actuators if you can afford not to.

Use Spring Boot 2.1 and Spring 5.1. Switch to 2.2 and 5.2 when they are available.

Fix the location of the Spring Boot config file(s) with spring.config.location (command line argument or System property etc.). Example for testing in IDE: spring.config.location=file://./src/main/resources/application.properties.

Switch off JMX if you don’t need it with spring.jmx.enabled=false (this is the default in Spring Boot 2.2)

Make bean definitions lazy by default. There’s a new flag spring.main.lazy-initialization=true in Spring Boot 2.2 (use LazyInitBeanFactoryPostProcessor for older Spring).

Unpack the fat jar and run with an explicit classpath.

Run the JVM with -noverify. Also consider -XX:TieredStopAtLevel=1 (that will slow down the JIT later at the expense of the saved startup time).

The mentioned LazyInitBeanFactoryPostProcessor (you can use it for Spring 1.5 if you cannot apply flag spring.main.lazy-initialization=true available from Spring 2.2):

public class LazyInitBeanFactoryPostProcessor implements BeanFactoryPostProcessor {

  @Override
  public void postProcessBeanFactory(ConfigurableListableBeanFactory beanFactory) {
      for (String beanName : beanFactory.getBeanDefinitionNames()) {
        BeanDefinition definition = beanFactory.getBeanDefinition(beanName);
        definition.setLazyInit(true);
      }
  }
}

You can also use (or write your own - it's simple) something to analyse beans initialization time: https://github.com/lwaddicor/spring-startup-analysis

Hope it helps!


B
Brent Bradburn

If you're trying to optimize development turn-around for manual testing, I strongly recommend the use of devtools.

Applications that use spring-boot-devtools will automatically restart whenever files on the classpath change.

Just recompile -- and the server will restart itself (for Groovy you only need to update the source file). if you're using an IDE (e.g. 'vscode'), it may automatically compile your java files, so just saving a java file can initiate a server restart, indirectly -- and Java becomes just as seamless as Groovy in this regard.

The beauty of this approach is that the incremental restart short-circuits some of the from-scratch startup steps -- so your service will be back up and running much more quickly!

Unfortunately, this doesn't help with startup times for deployment or automated unit testing.


n
naXa stands with Ukraine

WARNING: If you don't use Hibernate DDL for automatic DB schema generation and you don't use L2 cache, this answer is NOT applicable to you. Scroll ahead.

My finding is that Hibernate adds significant time to application startup. Disabling L2 cache and database initialization results in faster Spring Boot app startup. Leave cache ON for production and disable it for your development environment.

application.yml:

spring:
  jpa:
    generate-ddl: false
    hibernate:
      ddl-auto: none
    properties:
      hibernate:
        cache:
          use_second_level_cache: false
          use_query_cache: false

Test results:

L2 cache is ON and ddl-auto: update: 54 seconds INFO 5024 --- [restartedMain] o.s.web.context.ContextLoader : Root WebApplicationContext: initialization completed in 23331 ms INFO 5024 --- [restartedMain] b.n.spring.Application : Started Application in 54.251 seconds (JVM running for 63.766) L2 cache is OFF and ddl-auto: none: 32 seconds INFO 10288 --- [restartedMain] o.s.web.context.ContextLoader : Root WebApplicationContext: initialization completed in 9863 ms INFO 10288 --- [restartedMain] b.n.spring.Application : Started Application in 32.058 seconds (JVM running for 37.625)

Gained 22 seconds! Now I wonder what will I do with all this free time


hibernate.hbm2ddl.auto=update has nothing to do with l2 cache. ddl..=update specifies to scan the current database schema, and compute the neccesary sql in order to update schema to reflect your entities. 'None' doesn't do this verification(also, doesn't try to update schema). Best practices is to use a tool like liquibase, where you will handle your schema changes,and you can also track them.
@RaduToader this question and my answer are about speeding up Spring Boot startup time. They have nothing to do with Hibernate DDL vs Liquibase discussion; these tools both have their pros and cons. My point is that we can disable the DB schema update and enable only when necessary. Hibernate takes significant time on startup even when model did not change since the last run (for comparing DB schema with autogenerated schema). The same point is true for L2 cache.
yes, i know that, but my point was that this is a bit dangerous to not explain what it truly does. You might very easily end up with your db empty.
@RaduToader There was a link to a documentation page about DB initialization in my answer. Did you read it? It contains an exhaustive guide, listing all most popular tools (Hibernate and Liquibase, as well as JPA and Flyway). Also today I add a clear warning to the top of my answer. Do you think I need any other changes to explain consequences?
Perfect. Thank you
n
naXa stands with Ukraine

I find it strange nobody suggested these optimizations before. Here're some general tips on optimizing project build and startup when developing:

exclude development directories from antivirus scanner: project directory build output directory (if it's outside of project directory) IDE indices directory (e.g. ~/.IntelliJIdea2018.3) deployment directory (webapps in Tomcat)

project directory

build output directory (if it's outside of project directory)

IDE indices directory (e.g. ~/.IntelliJIdea2018.3)

deployment directory (webapps in Tomcat)

upgrade hardware. use faster CPU and RAM, better internet connection (for downloading dependencies) and database connection, switch to SSD (today NVMe SSD is the most performant storage). a video card doesn't matter.

use latest Gradle and JVM versions. Source: easy performance improvements.

parallel execution. By using more concurrent processes, parallel builds can reduce the overall build time significantly.

WARNINGS

the first option comes for the price of reduced security. the second option costs money (obviously).


The question is about improving boot time, not compile time.
@ArtOfWarfare read the question again. the question states the problem as "I'm unhappy that it takes that much [time], mostly because it breaks the development flow". I felt like this is a primary problem and addressed it in my answer.
D
Daulet Kadirbekov

In my case, there was too much breakpoints. When I clicked "Mute Breakpoints" and restarted application in debug mode, application started in 10 times faster.


佚名

To me it sounds like you're using a wrong configuration setting. Start by checking myContainer and possible conflicts. To determine who is using the most resources you have to check the memory maps (see the amount of data!) for each dependency at a time - and that takes plenty of time, as well... (and SUDO privileges). By the way: are you usually testing the code against the dependencies?