Using the transparency logs is a clever way to get a list of active domains.  Lets Encrypt certs expire every 90 days, so the domains are more likely to be active.  I don't have any suggestions for managing the data, but it sounds like a solvable problem.

Can you post more about how you are parsing the transparency logs?