11+ Apache Beam Jobs in Chennai | Apache Beam Job openings in Chennai

Data Engineer- Senior

Cubera is a data company revolutionizing big data analytics and Adtech through data share value principles wherein the users entrust their data to us. We refine the art of understanding, processing, extracting, and evaluating the data that is entrusted to us. We are a gateway for brands to increase their lead efficiency as the world moves towards web3.

What are you going to do?

Design & Develop high performance and scalable solutions that meet the needs of our customers.

Closely work with the Product Management, Architects and cross functional teams.

Build and deploy large-scale systems in Java/Python.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Create data tools for analytics and data scientist team members that assist them in building and optimizing their algorithms.

Follow best practices that can be adopted in Bigdata stack.

Use your engineering experience and technical skills to drive the features and mentor the engineers.

What are we looking for ( Competencies) :

Bachelor’s degree in computer science, computer engineering, or related technical discipline.

Overall 5 to 8 years of programming experience in Java, Python including object-oriented design.

Data handling frameworks: Should have a working knowledge of one or more data handling frameworks like- Hive, Spark, Storm, Flink, Beam, Airflow, Nifi etc.

Data Infrastructure: Should have experience in building, deploying and maintaining applications on popular cloud infrastructure like AWS, GCP etc.

Data Store: Must have expertise in one of general-purpose No-SQL data stores like Elasticsearch, MongoDB, Redis, RedShift, etc.

Strong sense of ownership, focus on quality, responsiveness, efficiency, and innovation.

Ability to work with distributed teams in a collaborative and productive manner.

Benefits:

Competitive Salary Packages and benefits.

Collaborative, lively and an upbeat work environment with young professionals.

Job Category: Development

Job Type: Full Time

Job Location: Bangalore

Roles & Responsibilities

• Data Engineering Excellence: Design and implement data pipelines using formats like JSON, Parquet, CSV, and ORC, utilizing batch and streaming ingestion.
• Cloud Data Migration Leadership: Lead cloud migration projects, developing scalable Spark pipelines.
• Medallion Architecture: Implement Bronze, Silver, and gold tables for scalable data systems.
• Spark Code Optimization: Optimize Spark code to ensure efficient cloud migration.
• Data Modeling: Develop and maintain data models with strong governance practices.
• Data Cataloging & Quality: Implement cataloging strategies with Unity Catalog to maintain high-quality data.
• Delta Live Table Leadership: Lead the design and implementation of Delta Live Tables (DLT) pipelines for secure, tamper-resistant data management.
• Customer Collaboration: Collaborate with clients to optimize cloud migrations and ensure best practices in design and governance.

Educational Qualifications

• Experience: Minimum 5 years of hands-on experience in data engineering, with a proven track record in complex pipeline development and cloud-based data migration projects.
• Education: Bachelor’s or higher degree in Computer Science, Data Engineering, or a related field.
• Skills
• Must-have: Proficiency in Spark, SQL, Python, and other relevant data processing technologies. Strong knowledge of Databricks and its components, including Delta Live Table (DLT) pipeline implementations. Expertise in on-premises to cloud Spark code optimization and Medallion Architecture.

Good to Have

• Familiarity with AWS services (experience with additional cloud platforms like GCP or Azure is a plus).

Soft Skills

• Excellent communication and collaboration skills, with the ability to work effectively with clients and internal teams.
• Certifications
• AWS/GCP/Azure Data Engineer Certification.

Hiring for Java Developer

Experience : 5 to 10 yrs

Notice Period : 0 to 15 days

Location : Pune

Work Mode : WFO (5 days)

As Java developer you would be expected to perform many duties throughout the development lifecycle of applications, from concept and design right through to testing. Here are some of the responsibilities you may have:

Develop high-level design and define software architecture

Implement and maintain quality systems within the group

Proficiently estimates, design approaches and nimbly move to alternate apporaches, if needed, develop and execute unit test strategies

Monitor and track tasks, and report status

Assist project heads to conceptualize, design, develop, test and implement technology solutions

Effectively collaborate with stakeholders and users to ensure customer satisfaction

Skill Set :

Java 7 / Java 8 with microservices, Multithreading, Springboot, Junit, kafka, Splunk (Good to have), Open Shift (Good to Have), Authentication/ Spring Security (Good to have)

Job Description

To be successful in this role, you should meet the following requirements:

Knowledge of Java Script, Java server pages and Angular JS is required. Knowledge of Dojo is advantageous. 

Knowledge of Core Java, Spring Core, Spring MVC , Spring Batch and Hibernate/JPA is required.

Knowledge of Databases such as Oracle and PL/SQL is advantageous.

Previous experience of working on Agile projects is required.

Excellent English Communication and presentation skills

Knowledge of JIRA, DEVOPS, control M scheduling and GSD is desirable.

Proven ability to clearly articulate implications of technical analysis to colleagues and stakeholders

Exhibit highest standards of ownership & accountability.

In this role, you will:

As a Full Stack Engineer, you will be part of the Compliance IT Data and MI Team.

Part of the wider Compliance Group Function, the Data and MI Team provides a foundational set of data capabilities which maximise synergy, minimise spend and ensures, ultimately, that the data serving various Compliance-related business processes is of the highest quality and standard.

As a Full Stack Engineer within Data & MI team, you will be responsible for accepting the work requests that are prioritised and developing the code enhancements to match the requirements as described in the chance request.

In addition, you will be responsible for the deployment of changes to the relevant Data & MI system code stack.

As an engineer you will be expected to be able to work and manage multiple change requests in parallel and be able to handle stakeholder queries by applying the appropriate analysis on the code. 

all - Pls start above skill

Internship Program Details:

Our Internship Program is designed to offer hands-on experience to students who are eager to explore the dynamic world of Artificial Intelligence (AI), Machine Learning (ML) and business Intelligence (BI). This program will provide participants with a unique opportunity to work on real-world projects, gain exposure to cutting-edge technologies, and collaborate with our talented team of experts.

Key Program Highlights:

Duration: 6 months, full time

Eligibility: MBA student with a keen interest in the dynamic fields of Business Intelligence (BI), Artificial Intelligence (AI), and Machine Learning (ML)

Location: Guindy, Chennai

Mentorship: Each intern will be assigned a dedicated mentor for guidance and support

Projects: Interns will work on live projects with tangible outcomes

Certificate: Upon successful completion, interns will receive a certificate of participation

1.     Significant experience of working in front-end web development
2.     Extensive programming experience in HTML5, CSS3, SASS or LESS, and Bootstrap, Foundation or Materialize
3.     Angular Material, Chart Libraries(D3, Leaflet, Amchart etc).
4.     Solid understanding and development experience in Angular
5.     Experience with Typescript
6.     Experience with tools like Redux, Webpack, Angular CLI and/or Gulp
7.     Experience consuming REST APIs

Job Title: Insurance Sales (Direct Channel)

Role: FLS ( Front Line Sales )

Total Exp: 3-5 Years

Relevant Exp: 2 years into insurance

Skills: Life Insurance Sales, Health insurance sales, Insurance sales

Locations: East, South, North, and West Zones.

WHAT WE'RE LOOKING FOR

•  Bachelors or master’s in software engineering, Computer Science or other relevant disciplines
•  5+ years experience as a Back-End or Full Stack Developer with hands-on experience working with Python with  3+ years Preferably with AWS Services knowledge (Lambda, API Gateway, CloudWatch, Queues, Topics, etc)
•  Strong Knowledge in Python v3.x Language
•  Experience in REST APIs with JSON
•  Error handling and Logging 
•  Any DB knowledge 
•  Knowledge in Node.js is an added advantage
•  Knowledge in implementing Terraform is a plus
•  Knowledge on Sumo Logic log aggregation is a plus
• Must know how to produce high quality, “Clean” code that is performant, maintainable and secure

We are looking for a full stack developer to produce scalable software solutions.

As a full stack developer, you should be comfortable around both front-end and back-end coding languages, development frameworks and third-party libraries. You should also be a team player with a knack for visual design and utility.

If you’re also familiar with Agile methodologies, we’d like to meet you.

Responsibilities:

• Developing front end website architecture.
• Designing user interactions on web pages.
• Developing back end website applications.
• Creating servers and databases for functionality.
• Ensuring cross-platform optimization for mobile phones.
• Ensuring responsiveness of applications.
• Working alongside graphic designers for web design features.
• Seeing through a project from conception to finished product.
• Designing and developing APIs.
• Meeting both technical and consumer needs.
• Staying abreast of developments in web applications and programming languages.

Requirements:

• Degree in Computer Science or related field
• Strong organizational and project management skills.
• Proficiency with fundamental front end languages such as HTML, CSS and JavaScript.
• Familiarity with JavaScript frameworks such as Angular JS, React and Amber.
• Proficiency with server side languages such as Python, Ruby, Java, PHP and .Net.
• Familiarity with database technology such as MySQL, Oracle and MongoDB.
• Excellent verbal communication skills.
• Good problem solving skills.
• Attention to detail.

Reporting directly to the Founder

The job requires a great deal of responsibility early on, but we're working on something exciting and there's lots of opportunity of growth and learning.

The job is full-time, remotely based, and with flexible hours.