Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Siva Narayanan ([email protected]) Consultant Software Engineer, Query Processing, EMC Greenplum 1 Monday, May 22, 2017 2 2 Finite resources - CPU/memory/IO/network Concurrent activity Different business value (Loads/Reports/Analytics) Different system impact (Simple/Complex queries) How can a DBA manage the system and keep everyone happy? Monday, May 22, 2017 3 3 Determine business value of a query upon arrival Translate that to fair share of CPU and Memory Resource reservation / Admission control Are the resources available? Run-time resource allocation Ensure that reservations are honored Adjust behavior as necessary Monday, May 22, 2017 4 4 Monday, May 22, 2017 5 5 Every query operator in a execution plan Continually measures its actual CPU usage and compares it with fair share If it uses too much, it sleeps for a short while Rinse, repeat I/O and network bandwidths are similar Monday, May 22, 2017 6 6 Every query operator in a execution plan Gets a portion of memory reserved for the entire query Memory intensive operators vs not Re-use memory between blocking operators If data is too large, they spill Net effect, every query uses up to its fair share Monday, May 22, 2017 7 7 Resource management is a big problem with big data Align resource allocation with business value Greenplum Parallel Database has mechanisms for CPU and Memory Monday, May 22, 2017 8 8 We’re hiring! [email protected] 9