Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Tools for job definition support Dmitri Golubkov [email protected] Introduction • There is no framework to support job definition development • Existing code is inflexible and has no web user interface for production • A lot of unbrowserable objects • Unmaintainable difficult source code of existing solution, there is no class architecture, difficult support and expensive modification Prototyping – first step • Django Framework based web application • Started with ProdMon by Maxim Potekhin • Trying with different use cases: – Task information: general, CPU usage – Task verification: parent id verification, input files verification, partnr verification – Search of tasks – Simple CPU statistics Task information Verification of Parent ID Verification of Input files and Partnr CPU usage Verifications • Verification of Parent ID: – Lists all Job objects in given Task (Ejobdefbig model) – Extracts from Jobpars field input file list and tid attribute value – Builds the list of IDs for all jobs and checks it Verifications • Verification of input files and Partnr: – Lists all Job objects in given Task (Ejobdefbig model) – Extracts from Jobpars field input file list – Сhecks that list is consistent – Lists Partnr values for all jobs and checks that the list does not contain repeating elements Search Task group statistics CPUCOUNT per job of task group Plans • Develop infrastructure to re-engeneer job definition (Django Framework based web application) • Keep coherence with others ProdDb applications (prodmon, db browser), study a possibility to have a common framework (ESB – Enterprise Service Bus ?) • Coming soon: – Test tool: • http://voatlas23.cern.ch:8000 • Bug reports to [email protected]