Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
THE US NATIONAL VIRTUAL OBSERVATORY Do we have our heads in the cloud? Matthew J. Graham (Caltech, NVO) IVOA Trieste: Grid & Web Services/AstroRG 20 May 2008 1 The Cloud is… • An elephant in a room of blind men: – – – – – – – SaaS Utility computing Web services Platform as a service Managed service provider Service commerce platform Internet integration – – – – fast scalable resilient available • All those things that the Grid promised but turned out not to be: • A virtualised notion of distributed computation, storage and communication over unlimited resources IVOA Trieste: Grid & Web Services/AstroRG 20 May 2008 2 Virtualisation • Virtual workspaces: – An abstraction of an execution environment that can be made dynamically available to authorized clients by using well-defined protocols – resource quota (e.g. CPU, memory share) – software configuration (e.g. O/S, provided services) • Implement on Virtual Machines (VMs): – abstraction of a physical host machine – hypervisor intercepts and emulates instructions from VMs and allows management of VMs – VMWare, Xen, etc. • Provide infrastructure API – Plug-ins to hardware/support structures IVOA Trieste: Grid & Web Services/AstroRG 20 May 2008 3 Different types of cloud • Amazon: • Google: • Microsoft: • Yahoo: • Sun • • • Zoho Adobe (AIR) Commercial providers: • Problem becomes availability of the right type of environment (hypervisor) – – – – “computing in the cloud” EC2 (with S3, SQS and SimpleDB) Use Xen VMs Images, Instances and Security – – Apps: Python module/API (with BigTable) Working also with IBM (Blue Cloud) – – Windows Live Silverlight – – Pipes Working with Computational Research Laboratories (CRL) – Project Hydrazine (JavaFX) – – SalesForce FlexiScale from XCalibre/Virtual Iron: “cooler than EC2” IVOA Trieste: Grid & Web Services/AstroRG 20 May 2008 4 Globus Workspace Metadata instance Create() Deployment request Inspect & manage Notify Workspace Factory Service Authorize & instantiate Workspace Service Workspace Resource Instance Deployment RP • Abstracts hyperviser using WSRF • Back-end implementation using Xen VMs on a variety of “science clouds” Contains GLOBUS IVOA Trieste: Grid & Web Services/AstroRG 20 May 2008 5 Clouds live in the Sky • A lightweight abstraction layer a la VOSpace • Resource oriented • Data and services both treated as first-class entities • Uses UWS interface for resource management IVOA Trieste: Grid & Web Services/AstroRG 20 May 2008 6 Identifiers and representations • Use XRIs to identify all resources including computational results: xri://@!the.sky/myService/(+<aspect>) • Different representations (in RDF) returned dependent on resource aspect: Aspect Meaning Representation object Data object VOSpace <node> image Service image VOResource instance Service instance UWS metadata IVOA Trieste: Grid & Web Services/AstroRG 20 May 2008 7 Use case • I have a data analysis service: ivo://nvo.caltech/MyService • Upload bytes of a VM image: xri://@!the.sky/MyService/(+object) • Create service instance: HTTP POST to http://@!the.sky/MyService/(+instance) Returns xri://@!the.sky/MyService/1234 • Commit instance to execution: HTTP POST to http://@!the.sky/MyService/1234/(+instance)/quote • Define computation: xri://@!the.sky/MyService/1234+ data@xri://@!the.sky/MyData/myTable1+ params@xri://@!the.sky/MyData/myParam1 • Link to results: xri://@!the.sky/MyData/myResults1 • Retrieve bytes: xri://@!the.sky/MyData/myResults1/(+object) IVOA Trieste: Grid & Web Services/AstroRG 20 May 2008 8 Is this just blue sky thinking? • “There’s probably a future business in offering an abstraction layer between cloud computing services” • “The missing element is cloud abstraction” • Proof-of-concept system based on VOSpace, UWS and a resource-oriented middleware layer in front of EC2 (and Google Apps) IVOA Trieste: Grid & Web Services/AstroRG 20 May 2008 9