Data Engineer
Roposo.com
2 - 5 Years
|
15 - 20 LPA
|
Gurgaon
A strong team filled with people focused on having fun while they work, Roposo is India's first ever social media platform where people express visually with homemade videos and photos. The app offers a seamless browsing experience with user-generated channels. Users can watch what is relevant to them and at the same time connect with a wide audience from around the globe. With its interesting post creation and editing tools, users can share their life, showcase their unrevealed talents, and voice their opinion on things that matter.
A brand of Relevant E-solutions headquartered in Gurgaon, Roposo is the brainchild of three IIT Delhi alumni, Mayank Bhangadia, Avinash Saxena and Kaushal Shubhank.
Website: https://www.roposo.com/
Designation: Data Engineer
Job Location: Gurgaon
Desired experience: 2-5 Years'
Salary: 15.00 LPA - 20.00 LPA
Education: B.Tech (CS/IT), MCA
Job Description:
- Understand & provide innovative solutions to business and product requirements using Big Data Architecture
- Take ownership of end-to-end data-pipeline including system design and integrating required Big Data tools & frameworks
-Implementing ETL processes and constructing data warehouse (HDFS, S3, etc.) at scale
- Developing highly performant Spark jobs for deriving data insights and building user preference, user segmentation, and recommendation engines
- Developing required querying and reporting tools for various business teams
Requirements:
- Working knowledge of Linux systems and distributed systems is a must.
- Knowledge of scripting language like python/SCALA
- Hands-on experience with writing Spark or Map-Reduce jobs and proficient understanding of distributed computing principles.
- Experience with Lambda Architecture and building required infrastructure.
- Proficient in more than one of Python, Java, Scala & Shell-Scripting.
- Experience with integration of data from multiple data sources
- Experience with various messaging systems, such as Kafka
Skills:
- Understanding of Spark and HDFS internals.
- Experience with Big Data querying tools, such as Hive, Pig, and Impala
- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
- Experience with resource managers such as YARN, Mesos
- Experience with stream-processing systems such as Storm, Spark-Streaming, etc.
- Knowledge of Lucene, SOLR, Elastic Search or any other similar technology is a plus.
- Prior experience in developing segmentation and recommendation systems is recommended.
- Experience with reporting tools like Apache Zepplin.
Education:
B.Tech/B.E., M.Tech./M.E., MCA
Work Experience:
2 - 5 Years
Salary
15 - 20 LPA
Industry
IT
