Optimizing Java is pretty good [0].
[0] https://www.goodreads.com/book/show/27015350-optimizing-java
It's not a book but Shipilev's Quarks are an excellent source for some of the more obscure corners:
https://shipilev.net/jvm/anatomy-quarks/
BTW green threads haven't been used for decades ;)
The last book on the JVM itself (e.g. stack-based byte code, class file format) I saw was from nearly 20 years ago. I cannot think about anything more modern. It's a niche which used to be popular in FinTech circles mostly. As such valuable info was scattered across random blogs and the JVM spec itself.
"Garbage Collection: Algorithms for Automatic Dynamic Memory Management" (https://www.amazon.com/Garbage-Collection-Algorithms-Automat...) seems to cover GC algorithms up to the CMS.
"The Art of Multiprocessor Programming" (https://www.amazon.com/Art-Multiprocessor-Programming-Mauric...) is for those bored by JCiP. But it's not about threads per se. I imagine nobody cares about the original green threads and I wouldn't expect quality literature on the subject until project Loom goes to prod.
I would recommend the following:
https://github.com/edubart/nelua-lang/wiki/Useful-Links-for-Research
The Garbage Collection Handbook: The Art of Automatic Memory Management [1]
Java Performance: The Definitive Guide, by Scott Oaks is great. https://www.oreilly.com/library/view/java-performance-the/97...
I strongly recommend following and listening to videos by Cliff Click who wrote HotSpot and worked on Azul and other VMs.
Cliff also has Coffee Compiler Club sessions on Fridays.
- https://mobile.twitter.com/cliff_click
- https://youtu.be/Hqw57GJSrac