Scientists will become Data Harvesters

Humanity will eventually figure out how to simulate everything. When that happens, what job scientists will have?

This is a slice of the life for what might happen to your average scientist.

It’s 2030.

You’re a researcher who’s just entered your fifth year at a public biology lab at a university in the UK. You’ve been educated in the world’s top institutions. You have a wealth of knowledge in both theory and experiment in all of the natural sciences. But your specialty is molecular physics. You’ve even won some early academic awards.

But science has advanced so rapidly in the past five years. Almost all the physical laws that govern our immediate world have already been theorised and verified, after an intergovernmental project to unify all of the physical research done by humanity so far.

There is a repository on Github that has all the code required to simulate anything you want, at the reasonable energy levels humans have access to. It can simulate molecules, general relativity, and more. And it’s all free! And it is fairly simple. It doesn’t use much more than a simulation of Schrodinger’s equations for the small stuff, and Einstein’s equations for the big stuff.

And so you might ask - since everything has already been discovered - what work is there left for you to do, as an ambitious mid career researcher? Finding stuff to contribute is still a big source of emotional anxiety for you. It goes beyond grand ambitions. To feed your family you need funding. And to get funding you need results! And to get results, you need to find a worthwhile problem to work on.

Well, luckily, there’s still a huge problem to solve. And everyone is working on it.

The problem is this. The code that simulates everything, is really, really slow. The time is takes to run is on the order of thousands of years, for systems with more than a thousand molecules.

And to fix this issue, your lab’s work is to create fast models. Your area of expertise is the quantum behaviour of molecules. It’s work that other institutions use to predict the properties of chemicals and proteins. Your customers are drugs companies and materials engineers.

Notice the word ‘fast’. It’s no longer about being correct. Being correct is basic and easy. The current simulations take a lot of time because in your case, it needs to solve Schrodinger’s equation for a really large system. This requires the computer to break down a really, really large matrix into smaller parts. The whole gamut scales to order n^7 in complexity, where n is the number of molecules. The first-order algorithms to do this would’ve been quite quick. But since we’re working on the state of the art, you want second and third order corrections that take into account electron correlation. Despite the fact that you’re working on a supercomputer, it’s a tall order.

So to make it fast, scientists have resorted to making computers learn the results of physical simulations. The pattern recognition makes the ‘learned’ version run thousands of times faster. It’s slightly more approximate, which means that the results aren’t as accurate as the physical simulations but that’s okay. Most of the end users of your research don’t need an extreme level of accuracy.

Your job consists of three steps. You repeat these three steps day in, and day out.


Step One - Running Some Simulations

A research task you are working on is predicting the spectrum of some theoretical protein shapes that you’ve designed. The goal is to match up these computed spectra with the light patterns of existing proteins whose shapes you don’t know. If you did this, you would be able to guess the shapes of these unknown proteins, and figure out how they behave.

You run some physics simulations on the lab supercomputer. The simulations haven’t got much better (in the theory sense) over the past decade. Not much has been discovered after quantum field theory, but it doesn’t matter. Because we have much more computing power. And the level of theory is enough for most our purposes, like making medicines.

You try to get a range of simulations by modelling as many different scenarios as possible, and varying parameters. This step takes a while - maybe a couple of days for a decently sized simulation. The hard part is getting the config and initial conditions right.


Step Two - Sense Checking

Step two is making sure the results of the simulation ‘make sense’. This is the hard part, and requires to use your brain muscles to make sure the first principles algorithms are working. You do some sense checks to see that the algorithms have converged to a solution without any breaks. You use theory to check that the energies and electric charges that the simulations have spit out make sense.

The work is finicky. The simulations take ages, but most of the delay comes from human error. You could have made a bug, like getting the configuration wrong or setting the initial conditions of the simulation in correctly. If you had made a single error, it could’ve taken hours or days for the algorithm to run into a road block and for you to realise your mistake. And so you’d have to start again. More time wasted.


Step Three - Curating the dataset and Modelling

You collect the results of the simulation into a database, which is shared publicly in a massive data centre spanning billions upon billions of terabytes. You upload the energy trajectories, the spectrum, the dipole moments, and other chemical quantities of interest.

After that, we now have the secret sauce:

You feed the results into a massive deep learning model, which then takes the results and learns the rules of the simulation. In your case, it’s learned how to compute the spectra of a protein in seconds, whereas the simulation took two days. The model is able to extend the results of the simulation to molecules you haven’t even tested in the first place.

All someone has to do now is to upload a protein that they want to find the spectrum of, and the model will spit it out in a matter of seconds!

Your work is done.


The Data Harvester

This kind of work has been going on for a long time. Since 2021, quantum chemists have been interested in the machine learning of classical force fields. They started by asking if the classical force field approximations could be ‘learned’ from quantum data, so that the simulations could run quicker. And it worked.

The research community kept experimenting with larger and larger models. Over the next decade, the models got so big that nobody knows how to interpret the machine learned models. No one really knows how they work.

But who cares! It works!

Ironically, no one needs machine learning engineers anymore. Labs are now looking for people who have a strong theoretical and commercial knowledge of where the simulations run the slowest. Your job is to figure out which datasets are required, and which routines would benefit from speeding up through machine learning. And so a lot of your skill set is just talking to people, to figure out what is important. It’s not all boring.

And here’s the good part. The scientific community recognizes that the hard work comes from curating and cleaning those datasets! Just five years ago, it was the machine learning engineers that took all the credit for progress. In 2024, DeepMind won the Nobel Prize in Chemistry. They ignored all of the hard spectroscopy work done to build the dataset. But that’s changed.

Your official position is called a ‘dataset harvester’. Not bad!

Read on Substack · « Previous · Next »