Job Title: Big Data Engineer
Full-time
Job Description:
- Work closely with data analysts and development stakeholders to identify data operations
- Design, document, and implement data lake and data stream processioning
- Support the testing, deployment and support of data processes
- Understand when to use data streams versus data lakes
- Design and implement support tools for data processes
- Benchmark systems, analyze bottlenecks and propose solutions to eliminate them
- Articulate and align fellow teams to data process designs
- Experience architecting and deploying highly scalable distributed systems
- Experience using Spark, Storm, Hadoop/MapReduce, SQL and other data processing tools and languages
- Experience building high-performance algorithms in scalable languages such as Scala, Python and R
- Familiarity with Big Data patterns of analysis such as machine learning, map reduce and complex event processing
- Experience working on Linux systems
- Software engineering experience (design, coding, testing, deployment and support)
- Experience using standard SDLC tools like Jira, Git, Jenkins etc.
- NoSQQL databases-3-7 years of experience
- Big data-data streams and data leaks: 3-7 years of experience
- Scalable languages such as Scala, Python and R: 3-7 years of experience
- Desired Qualifications:
- Ideal candidate has worked with Functional and Unit test based on frameworks to develop automated tests (Mocha, Jasmine, Cucumber, etc)
- Ideal candidate have worked on projects with CI/CD tools (Jenkins, Bamboo, Gitlab-CI, etc.)
- Ideal candidate has worked on projects with container based solutions (Docker, CoreOS, etc.)
- Ideal candidate has worked with Reactive Programming techniques in our mobile application and candidates would do well to familiarize themselves or have experience with Reactive Programming Techniques
- Ideal candidate has worked with Functional Programming support released recently in TypeScript 2.0 and wherever we can
- A candidate should be willing to learn functional programming paradigms or have previous experience with functional programming languages
- Skill Set:
- Functional Programming (Nodejs/Typescript):2 years of experience
- Angular: 2 years of experience
- Test Automation tools: 2 years of experience
- Continuous Integrations (CI)/Continuous Deployments (CD): 2 years of experience
- Minimum Education Required: Bachelor's Degree
Apply online at https://goo.gl/QeWShx.
Date Posted: 9/7/2017