I was musing about how to optimize it a bit further for multiple page requests.

Would it not be possible to do something like this? (pseudo)

on page request:

if (!user_has_visited_before) { insert_css_as_inline_into_html(); lazy_load_css_file_with_js(); }

else { insert_link_to_css_file_into_html(); }