Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Big Data Analytics with Excel Peter Myers Bitwise Solutions [email protected] http://www.linkedin.com/in/peterjsmyers Cheap Storage Inexpensive Computing (Continued) “Big data is a collection of data sets so large and complex that it becomes awkward to work with using on-hand database management tools. Difficulties include capture, storage, search, sharing, analysis, and visualization.” – Wikipedia (Continued) VOLUME (Size) VARIETY (Structure) VELOCITY (Speed) (Continued) Petabytes Click stream Wikis/blogs Sensors RFID Devices Social sentiment Big Data Audio/video Terabytes Log files Spatial and GPS coordinates Data market feeds Gigabytes eGov feeds Weather Megabytes Text/image Data Complexity: Variety and Velocity Responding to New Questions How do I better predict future outcomes? What’s the social sentiment of my product? How do I optimize my services based on patterns of weather, traffic, etc.? Comparison to Traditional RDBMS TRADITIONAL RDBMS Data Size Access Updates Structure Integrity Scaling DBA Ratio HADOOP + (Continued) How it Works: 1 – Data Storage Demo Storing Files in Azure Blob Storage How it Works: 2 – Take the Processing to the Data RUNTIME Server Server Server Server Legend Red = Core Hadoop Blue = Data processing Green = Packages Distributed Processing (MapReduce) Distributed Storage (HDFS) Purple = Microsoft integration points and value adds Orange = Data Movement Demo Word Count with Pig (The “Hello World” for Hadoop) Data Hadoop Analytics Demo Self-Service BI with Hive Benefits Considerations http://www.microsoft.com/en-us/server-cloud/solutions/big-data.aspx http://azure.microsoft.com/en-us/documentation/services/hdinsight/ http://hortonworks.com/tutorials Explore Everything PASS Has to Offer Free SQL Server and BI Web Events Free 1-day Training Events Regional Event This is Community Business Analytics Training Local User Groups Around the World Session Recordings PASS Newsletter Free Online Technical Training