Convert CORSIKA simulations on Stoomboot

Convert CORSIKA stored showers to HDF5 on Stoomboot

Automatically submits Stoomboot jobs to convert corsika data. The script store_corsika_data can be used to convert a DAT000000 CORSIKA file to a HDF5 file. This script checks our data folder for new or unconverted simulations and creates Stoomboot jobs to perform the conversion.

This job is run as a cron job to ensure the simulations remain up to date.

sapphire.corsika.qsub_store_corsika_data.all_seeds()

Get set of all seeds in the corsika data directory

sapphire.corsika.qsub_store_corsika_data.seeds_processed()

Get the seeds of simulations for which the h5 is already created

sapphire.corsika.qsub_store_corsika_data.seeds_in_queue()

Get set of seeds already queued to be processed

sapphire.corsika.qsub_store_corsika_data.write_queued_seeds(seeds)

Write queued seeds to file

sapphire.corsika.qsub_store_corsika_data.append_queued_seeds(seeds)

Add seed to the queued seeds file

sapphire.corsika.qsub_store_corsika_data.get_seeds_todo()

Get seeds to be processed

sapphire.corsika.qsub_store_corsika_data.filter_large_seeds(seeds_todo)

Exclude seeds for data files that are to large

sapphire.corsika.qsub_store_corsika_data.store_command(seed)

Write queued seeds to file

sapphire.corsika.qsub_store_corsika_data.run(queue)

Get list of seeds to process, then submit jobs to process them

sapphire.corsika.qsub_store_corsika_data.main()