<div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jun 8, 2023 at 4:51 PM John Rose <<a href="mailto:john.r.rose@oracle.com">john.r.rose@oracle.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><u></u>
<div><div style="font-family:sans-serif"><div style="white-space:normal">
<p dir="auto">On 8 Jun 2023, at 9:52, Dan Heidinga wrote:</p>
</div><div style="white-space:normal"><blockquote style="margin:0px 0px 5px;padding-left:5px;border-left:2px solid rgb(119,119,119);color:rgb(119,119,119)"><p dir="auto">On Thu, Jun 8, 2023 at 12:44 PM John Rose <<a href="mailto:john.r.rose@oracle.com" target="_blank">john.r.rose@oracle.com</a>> wrote:</p>
<blockquote style="margin:0px 0px 5px;padding-left:5px;border-left:2px solid rgb(153,153,153);color:rgb(153,153,153)"><p dir="auto">On 8 Jun 2023, at 9:01, Dan Heidinga wrote:</p>
<blockquote style="margin:0px 0px 5px;padding-left:5px;border-left:2px solid rgb(187,187,187);color:rgb(187,187,187)"><p dir="auto">If we decouple the list of preloadable classes from the classfile, how
<br>
would non-jdk classes be handled?> What if instead of ditching the</p>
</blockquote><p dir="auto">attribute, or treating it like an</p>
<blockquote style="margin:0px 0px 5px;padding-left:5px;border-left:2px solid rgb(187,187,187);color:rgb(187,187,187)"><p dir="auto">optimization, we firmed up the contract and treated it as a guarantee…</p>
</blockquote><p dir="auto">If we go down this route, let’s consider putting the control information
<br>
into a module file (only) for starters. (Maybe class file later if
<br>
needed.) There would be fewer states to document and test, since (by
<br>
definition) class files could not get out of sync.</p>
<p dir="auto">A module would document, in one mplace, which types it would “prefer” to
<br>
preload in order to optimize its APIs (internal or external).</p>
</blockquote><p dir="auto">This might lead to more class loading than intended. The current approach
<br>
has each classfile register the list of classes it wants preloaded to get
<br>
the best linkage which means we only have to load those classes if we link
<br>
the original class. There's a natural trigger for the preload and a
<br>
limited set of classes to load.</p>
</blockquote></div>
<div style="white-space:normal">
<p dir="auto">There’s a spectrum of tradeoffs here: We could put preload attributes on every method and field, to get the maximum amount of fine-grained lazy (pre-)loading, or put them in a global file per JVM instance. The more fine-grained, the harder it will be to write compliance testing, I think.</p></div></div></div></blockquote><div><br></div><div>Agreed. There's a sweet spot between expressiveness and overheads (testing, metadata, etc). Classfiles have historically been the place where the JVM tracks this kind of information as that fits well with separate compilation and avoids the "external metadata" problems of ie: GraalVM's extra-linguistic configuration files.</div><div><br></div><div>When compiling the current class, javac already requires directly referenced classes to be findable and thus has the info required to write a preload attribute. Does javac necessarily have the same info when compiling the module-info classfile? Maybe when finding the non-exported packages for the module javac (or jlink? or jmod?) could also find the value classes that need preloading?</div><div><br></div><div>Moving it into a separate pass like this doesn't feel like quite the right fit though as it excludes the classpath and complicates the other tools processing of the modules.</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div style="font-family:sans-serif"><div style="white-space:normal">
</div><div style="white-space:normal"><blockquote style="margin:0px 0px 5px;padding-left:5px;border-left:2px solid rgb(119,119,119);color:rgb(119,119,119)"><p dir="auto">Moving to a single per-module list loses the natural trigger and may
<br>
pre-load more classes than the application will use. If Module A has
<br>
classes {A, B, C} and each one preloads 5 separate classes, with a
<br>
per-module list that's forcing the loading of 15 additional classes (plus
<br>
supers, etc). With a per-class list, we only preload the classes on a
<br>
per-use basis. More of a pay for what you use model.</p>
<p dir="auto">Is there a natural trigger or way to limit the preloads to what I might use
<br>
with the per-module file?</p>
</blockquote></div>
<div style="white-space:normal">
<p dir="auto">That’s a very good question. I think what Preload <em>really is</em> is a list of “names that may require special handling before using in APIs”. They don’t need to be loaded when the preload attribute is parsed; they are simply put in a “watch list” to trigger additional loading <em>when necessary</em>. (This is already true.) So I think if we move the preload list to (say) the module level (if not a global file), then the JVM will have its watch list. (And, in fewer chunks than if we put all the stuff all the time redundantly in all class files that might need them: That requires frequent repetition.) The JVM can use its watch list as it does today, with watch lists populated separately for each class file.</p></div></div></div></blockquote><div>I initially thought a global list would lead to issues if two different classloaders defined classes of the same name but since this is a "go and look" signal, early loading based on name should be fine even in that case as each loader that mentions the name would be asked to be asked to load their version of the named class. So I think a per-JVM list would be OK from that perspective (though I still don't like it).</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div style="font-family:sans-serif"><div style="white-space:normal">
<p dir="auto">To emphasize: A watch list does not require loading. It means, “if you see this name at a point where you could use extra class info, then I encourage you to load sooner rather than later”. The only reason it is “a thing” at all is that the default behavior (of loading either as late as possible, or as part of a CDS-like thingy) should be changed only on an explicit signal.</p></div></div></div></blockquote><div>While true for what the JVM needs, this is hard behaviour to explain to users and challenging for compliance test writers (or maybe not if we continue to treat preload as an optimization). Is this where we want to spend our complexity budget? Part of why I'm circling back to treating preload as a per-classfile attribute that forms a requirement on the VM rather than as an optimization is that the model becomes clearer for users, developers and testers.</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div style="font-family:sans-serif"><div style="white-space:normal">
<p dir="auto">And, hey, maybe CDS is all the primitive we need here: Just run -Xdump with all of your class path loaded. Et voila, no Preload at all.</p></div></div></div></blockquote><div> Users may find this behaviour surprising - I ran with a CDS archive and my JVM loaded classes earlier than it would have otherwise?</div><div><br></div><div>--Dan</div></div></div>