Download BIG DATA ENGINEER Response SA, on behalf of its client, a

yes no Was this document useful for you?
   Thank you for your participation!

* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project

Document related concepts

Data vault modeling wikipedia , lookup

Business intelligence wikipedia , lookup

Response SA, on behalf of its client, a multinational organization, key player in its field, is
seeking to recruit a Big Data Engineer:
Big Data Engineer is responsible for collecting, storing, processing, and analyzing huge sets of
data. The position’s primary focus will be on choosing optimal solutions to use for these
purposes, then maintaining, implementing, and monitoring them. The job holder is also
responsible for integrating the solutions with the architecture used across the company.
-Responsible for contributing to Architecture & Overall Solution Design at a technical level
focusing in particular in the following areas:
 Collecting huge sets of data from various Enterprise data sources (structured, semistructured and unstructured) and integrating them into Data Lakes. The process
should be built with a balance between performance and extensibility.
 Supporting data mining and analytics activities at a low level and drive their
automation and productization.
-Accountable for the delivery/implementation of Big Data, Analytics and Visualization
structures in order to provide data and analytics results to business users. Responsibilities
 Gathers data requirements from analytics and business departments and builds
large-scale data processing systems
 Tackles challenges in the areas of data modelling, ETL and data mining (from a data
management aspect) especially with Big Data technologies
 Automates data mining & analytics into the Big Data architecture of the Organization
(low level)
 Performance tuning to ensure that the solutions comply with service level
-Provides input/insight and offers clarifications, if needed, regarding the following functions:
 Use Case delivery management: providing input regarding progress on activities and
tasks for which responsible
 Estimation and demand management process: providing input for the estimation of
relevant activities and tasks
 Environment Support & Maintenance: providing clarifications and support if/where
needed for the components within the scope
Bachelor's degree in Computer Science/Information Technology or related field
2+ years working experience as Big Data Engineer with knowledge/experience in
more than 3 of the following areas:
 Proficiency with Hadoop v2 core technology stack (HDFS, MapReduce,
YARN, Spark)
 Experience in some Big Data tools and frameworks for data management
and Stream Processing, such as Pig, Hive, Impala, Spark SQL, Spark
Streaming, Kafka Streams etc
 Experience in some Big Data tools for data migration/data transfer such as
Sqoop, Flume, DistCp etc
 Experience working in traditional RDBMS and ETL tools
 Experience in dimensional data models for Data Warehouses
 Experience in Business Intelligence / Data Visualization tools
 Hands on development experience in some of the following: Java, Python,
Scala, or R
Excellent English communication skills (written & oral)
Military service fulfilled
Any of the following skills will be considered a plus:
 Experience in Oracle products (Exadata, ODI).
 Experience in Microsoft BI Products.
 Experience in Hadoop Cloudera clusters and services.
 Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.
 Exposure to Telecommunication industry
Interested candidates, who meet the above requirements, are requested to apply with their
CV online.
All applications will be treated with strict confidentiality.