coordinate ensure RAM usage Euclid_analysis python script remains under RAM limit of Norma
Dear @nutma and @stolk, communicating via this gitlab issue I will ensure that you two solve how to ensure that Oscar's script will have a maximum RAM usage that is compliant with the RAM availability of computer Norma.
Foreseen roadmap:
- Oscar instructs Teake so Teake reproduces himself the issue Oscar has experienced in Teake's preferred environment.
- Oscar explains to Teake his ideas on how to solve the issue.
- Gijs coordinates solving Oscar's RAM issue
- available RAM on a machine (via
>grep MemTotal /proc/meminfo)- norma3 and norma4 both have each: 750 Gbyte
- nieuwland: 7.5Gbyte
- available RAM on a machine (via
- Oscar+Gijs obtain Teake's advice where to store the ~50Gbyte volume of input files (i.e., the 100%-sized versions)
- Teake instructs Oscar so Oscar reproduces the successful execution for the 100%-sized simulation himself in Oscar's preferred environment.
Handy links: Gijs-to-self: mailthreadWithJustOscar, mailthreadWithTeakeAndS2team, CPU & RAM profiling, FilWebsite