PenSimEnv
The Penicillin Fermentation Env aims to simulate the penicillin production process. The simulation itself is based on PenSimPy and The development of an industrial-scale fed-batch fermentation simulation.
There are in total 15 features, namely [‘Discharge rate’, ‘Sugar feed rate’, ‘Soil bean feed rate’, ‘Aeration rate’, ‘Back pressure’, ‘Water injection/dilution’, ‘pH’, ‘Temperature’, ‘Acid flow rate’, ‘Base flow rate’, ‘Cooling water’, ‘Heating water’, ‘Vessel Weight’, ‘Dissolved oxygen concentration’, ‘Yield Per Step’]. By default we set each episode (or ‘batch’ in the manufacturing industry) to have a duration of 230 hours in real life, and the time interval between each step is 12 minutes. The detailed reactor description is shown as below:
For a controller, we want to optimize the episode production (or batch yield), while avoid extreme inputs, outputs or changes that can potentially break the reactor. In order to maintain the safety constraints, we provide the input and state setpoints (it is a equilibrium, when input=setpoint_input and state=setpoint_state, the state is still setpoint_state for the next step), and we restricted the input search space to be within +/- 10% of setpoint inputs.
- We also want to share the performance of a practical baseline recipe and a learnable controller based on Gaussian Process based Bayesian Optimization (gpei), which contains 10 random starts +
1000 gpei searches, as shown below:
The base penicillin yield (in red diamond point, ~3640 kg) is based on the baseline recipe without any optimizations. The first 10 random searching results are plotted in green stars and the following 1000 gpei searches are displayed in blue stars. The red line refers to the best yield so far and the cyan dashed line shows the average yields so far, respectively. Also, the time cost for each optimization step (mainly on gpei) was recorded and displayed in red. Some key statistics are shown in the table below.
Penicillin Yield [kg] |
Time Elapsed for GPEI [s] |
|
|---|---|---|
min |
2954 |
2.23 |
max |
4080 (⬆️ 12%) |
323.07 |
mean |
3797 (⬆️ 4%) |
77.44 |
std |
233 |
109.55 |
sum |
very high |
77437.72 (21.51 h) |