11+ Dataflow architecture Jobs in Pune | Dataflow architecture Job openings in Pune

CANDIDATE WILL BE DEPLOYED IN A FINANCIAL CAPTIVE ORGANIZATION @ PUNE (KHARADI)

Below are the job Details :-

Experience 10 to 18 years

Mandatory skills –

• data migration,
• data flow

The ideal candidate for this role will have the below experience and qualifications:  

• Experience of building a range of Services in a Cloud Service provider (ideally GCP)  
• Hands-on design and development of Google Cloud Platform (GCP), across a wide range of GCP services including hands on experience of GCP storage & database technologies. 
• Hands-on experience in architecting, designing or implementing solutions on GCP, K8s, and other Google technologies. Security and Compliance, e.g. IAM and cloud compliance/auditing/monitoring tools 
• Desired Skills within the GCP stack - Cloud Run, GKE, Serverless, Cloud Functions, Vision API, DLP, Data Flow, Data Fusion 
• Prior experience of migrating on-prem applications to cloud environments. Knowledge and hands on experience on Stackdriver, pub-sub, VPC, Subnets, route tables, Load balancers, firewalls both for on premise and the GCP.  
• Integrate, configure, deploy and manage centrally provided common cloud services (e.g. IAM, networking, logging, Operating systems, Containers.)  
• Manage SDN in GCP Knowledge and experience of DevOps technologies around Continuous Integration & Delivery in GCP using Jenkins.  
• Hands on experience of Terraform, Kubernetes, Docker, Stackdriver, Terraform  
• Programming experience in one or more of the following languages: Python, Ruby, Java, JavaScript, Go, Groovy, Scala  
• Knowledge or experience in DevOps tooling such as Jenkins, Git, Ansible, Splunk, Jira or Confluence, AppD, Docker, Kubernetes  
• Act as a consultant and subject matter expert for internal teams to resolve technical deployment obstacles, improve product's vision. Ensure compliance with centrally defined Security 
• Financial experience is preferred 
• Ability to learn new technologies and rapidly prototype newer concepts 
• Top-down thinker, excellent communicator, and great problem solver

Exp:- 10  to 18 years

Location:- Pune

Candidate must have experience in below.

• GCP Data Platform
• Data Processing:- Data Flow, Data Prep, Data Fusion
• Data Storage:- Big Query, Cloud Sql,
• Pub Sub, GCS Bucket

Skills: Digital: Application Programming Interface (API)~Java Rest web services~ AI Agents~ AI & Gen AI - Products & Tools

Job Description – Gen AI Developer

Exp: 5-8 years

Role Summary

We are looking for a skilled AI Developer to design, develop, and deploy AI-powered applications, intelligent automation solutions, and Generative AI systems. The ideal candidate should have hands-on experience in Python development, Large Language Models (LLMs), Prompt Engineering, AI agent development, workflow automation, and cloud AI services.

Key Responsibilities

AI Application Development

· Design and develop AI-powered business applications.

· Build enterprise AI assistants, copilots, and AI agents.

· Develop AI APIs and intelligent automation workflows.

· Integrate AI capabilities into enterprise applications.

· Create scalable and production-ready AI solutions.

Generative AI Development

· Build applications using Large Language Models (LLMs).

· Develop Prompt Engineering frameworks.

· Implement RAG (Retrieval-Augmented Generation) solutions.

· Integrate OpenAI and Azure OpenAI models.

· Develop conversational AI and intelligent assistants.

Intelligent Automation

· Build workflow automation solutions.

· Develop AI-driven business process automation.

· Create intelligent document processing solutions.

· Integrate AI with enterprise business systems.

· Automate repetitive operational processes.

Conversational AI

· Build AI chatbots and virtual assistants.

· Design conversational workflows.

· Implement multi-channel AI solutions.

· Enable human-in-the-loop AI workflows.

Model Development & Integration

· Develop and deploy machine learning models.

· Fine-tune AI models for business use cases.

· Build inference APIs and AI services.

· Support model lifecycle management.

Mandatory Technical Skills: Programming Languages

Must Have

· Python

· SQL

· REST APIs

· JSON

Technical requirements in current AI architecture documents explicitly highlight strong experience in Python and AI solution development.

Generative AI

Must Have

· OpenAI

· Azure OpenAI

· Prompt Engineering

· LLM Integration

· AI Assistants

· RAG Architecture

Good to Have

· Claude

· Gemini

· Llama Models

· Mistral

AI leadership and AI architecture requirements specifically reference Generative AI, Azure OpenAI, prompt engineering, orchestration, and enterprise AI adoption.

AI Frameworks

Preferred

· LangChain

· Semantic Kernel

· LlamaIndex

· Hugging Face

· AutoGen

· CrewAI

Machine Learning

Must Have

· Scikit-Learn

· TensorFlow

· PyTorch

Concepts

· Model Training

· Model Evaluation

· Model Deployment

· Feature Engineering

NLP & Semantic Search

· Natural Language Processing

· Embeddings

· Vector Search

· Semantic Search

· Text Analytics

· Knowledge Retrieval

Microsoft AI Stack

Must Have

· Microsoft Copilot Studio

· Power Automate

· Azure AI Services

· Azure AI Foundry

The internal AI Architecture JD explicitly calls out Copilot Studio, Power Automate, Azure AI Foundry, and Generative AI technologies as core competencies.

Cloud Platforms

Microsoft Azure

· Azure AI Services

· Azure OpenAI

· Azure AI Foundry

· Azure Functions

· Azure App Services

· Azure Storage

· Azure Machine Learning

AWS (Preferred)

· SageMaker

· Bedrock

· Lambda

· S3

Cloud-native AI platforms including Azure ML and SageMaker are referenced within internal AI/ML architecture requirements.

Automation & Integration

· Power Automate

· Workflow Automation

· API Integration

· Microsoft Graph API

· Intelligent Process Automation

MLOps & DevOps

Preferred

· Git

· Azure DevOps

· CI/CD Pipelines

· Docker

· Kubernetes

· Model Monitoring

· Model Versioning

Current AI architecture standards include MLOps lifecycle management, model deployment, monitoring, and CI/CD integration.

BFSI Domain Experience (Preferred)

Experience in:

· Banking

· Corporate Banking

· Payments

· Risk Management

· Fraud Detection

· Insurance

· Financial Data Analytics

Soft Skills

· Strong analytical mindset

· Innovation-driven approach

· Problem-solving skills

· Excellent communication skills

· Stakeholder management

· Team collaboration

Educational Qualification

· B.E. / B.Tech.

· MCA

· M.Tech.

· Computer Science

· Artificial Intelligence

· Data Science

· Machine Learning

Preferred Certifications

· Microsoft Azure AI Engineer Associate (AI-102)

· Azure Fundamentals (AZ-900)

· Azure OpenAI Certifications

· Machine Learning Certifications

· Generative AI Certifications

EDUCATION & EXPERIENCE :

- A professional degree in Computer Science from a reputable institution, backed by a consistent academic record.

- A knack for problem-solving, data structures, and algorithms.

- Proficiency in ElasticSearch.

- 6+ years of hands-on development experience, primarily in building products for large enterprises.

- Exceptional communication skills.

- Mastery in Java programming; familiarity with Python is a plus.- Experience with Spring Boot.

- Practical knowledge of one or more cloud-based technologies (e.g., ElasticSearch, Storm, Hazelcast, MongoDB, Ceph, Kafka) is highly desirable.

- Expertise in building concurrent and/or parallelized, highly performant scalable applications.

- A track record of identifying and addressing complex issues in scalable deployments.

- Exposure to Service-Oriented Architecture (SOA) and Test-Driven Development (TDD) is an added advantage.

ROLES & RESPONSIBILITIES :

- Dive deep into technical aspects (Analysis, Design & Implementation) as required.

- Take complete ownership of features within the product.

- Engage in debates and detailed discussions about functional and non-functional requirements with our Product Management team.

- Collaborate with the team to design solutions, seeking stakeholder input before implementation.

- Create essential artifacts such as functional specifications and detailed designs for your assigned features.

- Implement intricate features with an unwavering commitment to quality, following the Test- Driven Development (TDD) process.

- Maintain open lines of communication, promptly reporting risks and progress to your supervising manager.

- Share your expertise and mentor team members.

- Provide support by troubleshooting and creating Root Cause Analysis (RCA) for production issues, subsequently working on short-term and long-term solutions.

We are seeking a highly skilled Senior Java Developer with expertise in Microservices architecture and Spring Boot to join our dynamic team. The ideal candidate will be responsible for designing, developing, and deploying scalable, high-performance backend solutions.

Key Responsibilities:

• Design, develop, and maintain Java-based applications using Spring Boot and Microservices architecture.
• Develop and implement RESTful APIs and integrate them with front-end components.
• Optimize application performance and ensure high availability and scalability.
• Collaborate with cross-functional teams to gather and analyze business requirements.
• Implement security best practices, including authentication and authorization mechanisms.
• Develop and maintain unit and integration tests to ensure robust software quality.
• Work with DevOps teams to automate CI/CD pipelines and ensure smooth deployment processes.
• Monitor and troubleshoot production issues, providing efficient resolutions.
• Stay updated with emerging technologies and best practices in Java development and cloud-native applications.

Required Skills & Qualifications:

• 8+ years of hands-on experience in Java development.
• Expertise in Spring Boot, Spring MVC, Spring Cloud, and other Spring frameworks.
• Strong experience with Microservices architecture and API development.
• Proficiency in RESTful services, JSON, and Swagger/OpenAPI.
• Hands-on experience with SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Redis).
• Familiarity with message brokers like Kafka or RabbitMQ.
• Experience with containerization (Docker, Kubernetes) and cloud platforms (AWS, Azure, or GCP).
• Solid understanding of CI/CD pipelines using Jenkins, GitLab, or similar tools.
• Strong problem-solving skills and the ability to work in an agile development environment.
• Excellent communication and teamwork skills.

Nice-to-Have:

• Experience with GraphQL and event-driven architecture.
• Knowledge of reactive programming using WebFlux.
• Familiarity with observability tools like Prometheus, Grafana, ELK stack.

Role: .NET Developer with React.js

3+ years in .NET/C# development (ASP.NET, Web API, MVC or Core)

Expertise in React.js (Redux, Hooks, component design)

We are looking for a Senior Data Engineer with strong expertise in GCP, Databricks, and Airflow to design and implement a GCP Cloud Native Data Processing Framework. The ideal candidate will work on building scalable data pipelines and help migrate existing workloads to a modern framework.

• Shift: 2 PM 11 PM
• Work Mode: Hybrid (3 days a week) across Xebia locations
• Notice Period: Immediate joiners or those with a notice period of up to 30 days

Key Responsibilities:

• Design and implement a GCP Native Data Processing Framework leveraging Spark and GCP Cloud Services.
• Develop and maintain data pipelines using Databricks and Airflow for transforming Raw → Silver → Gold data layers.
• Ensure data integrity, consistency, and availability across all systems.
• Collaborate with data engineers, analysts, and stakeholders to optimize performance.
• Document standards and best practices for data engineering workflows.

Required Experience:

• 7-8 years of experience in data engineering, architecture, and pipeline development.
• Strong knowledge of GCP, Databricks, PySpark, and BigQuery.
• Experience with Orchestration tools like Airflow, Dagster, or GCP equivalents.
• Understanding of Data Lake table formats (Delta, Iceberg, etc.).
• Proficiency in Python for scripting and automation.
• Strong problem-solving skills and collaborative mindset.

⚠️ Please apply only if you have not applied recently or are not currently in the interview process for any open roles at Xebia.

Looking forward to your response!

Best regards,

Vijay S

Assistant Manager - TAG

https://www.linkedin.com/in/vijay-selvarajan/

TVARIT GmbH develops and delivers solutions in the field of artificial intelligence (AI) for the Manufacturing, automotive, and process industries. With its software products, TVARIT makes it possible for its customers to make intelligent and well-founded decisions, e.g., in forward-looking Maintenance, increasing the OEE and predictive quality. We have renowned reference customers, competent technology, a good research team from renowned Universities, and the award of a renowned AI prize (e.g., EU Horizon 2020) which makes Tvarit one of the most innovative AI companies in Germany and Europe. 

We are looking for a self-motivated person with a positive "can-do" attitude and excellent oral and written communication skills in English. 

We are seeking a skilled and motivated Data Engineer from the manufacturing Industry with over two years of experience to join our team. As a data engineer, you will be responsible for designing, building, and maintaining the infrastructure required for the collection, storage, processing, and analysis of large and complex data sets. The ideal candidate will have a strong foundation in ETL pipelines and Python, with additional experience in Azure and Terraform being a plus. This role requires a proactive individual who can contribute to our data infrastructure and support our analytics and data science initiatives. 

Skills Required 

• Experience in the manufacturing industry (metal industry is a plus)  
• 2+ years of experience as a Data Engineer 
• Experience in data cleaning & structuring and data manipulation 
• ETL Pipelines: Proven experience in designing, building, and maintaining ETL pipelines. 
• Python: Strong proficiency in Python programming for data manipulation, transformation, and automation. 
• Experience in SQL and data structures  
• Knowledge in big data technologies such as Spark, Flink, Hadoop, Apache and NoSQL databases. 
• Knowledge of cloud technologies (at least one) such as AWS, Azure, and Google Cloud Platform. 
• Proficient in data management and data governance  
• Strong analytical and problem-solving skills. 
• Excellent communication and teamwork abilities. 

Nice To Have 

• Azure: Experience with Azure data services (e.g., Azure Data Factory, Azure Databricks, Azure SQL Database). 
• Terraform: Knowledge of Terraform for infrastructure as code (IaC) to manage cloud. 

1. Develop and implement sales strategies and tactics to drive revenue growth for the company's corporate sales division

2. Identify new business opportunities and establish strong relationships with potential clients to expand the company's customer base

3. Execute effective sales pitches and presentations to showcase our products and services, highlighting their unique value proposition to potential clients

4. Conduct thorough market research to understand industry trends, competitor activities, and customer needs, ensuring our offerings remain competitive and relevant

5. Collaborate closely with cross-functional teams, including marketing and product development, to align sales efforts with overall company objectives

6. Manage the entire sales cycle, from lead generation to closing deals, while meeting or exceeding sales targets and KPIs

7. Maintain accurate and up-to-date sales records and reports, providing regular feedback and insights to the management team to drive continuous improvement

We are seeking a highly motivated and dynamic corporate sales executive to join our team at Setup Mastery. As a key member of our sales division, you will play a pivotal role in driving revenue growth by developing and implementing effective sales strategies. With your exceptional sales pitch skills and excellent communication abilities, you will identify new business opportunities and build strong relationships with potential clients. Your deep understanding of sales processes and market dynamics, coupled with your ability to effectively communicate the unique value of our products and services, will be instrumental in closing deals and exceeding sales targets.

Requires 9 hours

-Work from Office( Balewadi High Street) Involved

Day-to-day responsibilities include:

1. Research and post on a LinkedIn community we are building

2. Conduct market research into social media trends, influencers, ETC

3. Explore AI tools & SaaS tools that can automate and scale current efforts

4. Come up with creative strategies to improve engagement/impressions

5. Research on competitors' outreach strategies.

Team Lead (L3 Technical Support) 

Job Description

PierianDx, a leader in the clinical genomics space, is currently seeking talented and motivated technical leads to lead the product L3 technical support teams. As a Technical Lead for L3 team, your duties will primarily be working with the customer success department on technical issues including software system design and maintenance. You will also be involved in directing team members and identifying/managing risk in collaborations with other teams.

To be successful in this role, you will need to gain extensive knowledge of PierianDx products (includes user workflow, user needs, end-to-end workflow, product architecture and design), problem-solving skills, knowledge of best practices and the software development life-cycle.

Location: Pune

Education

• Bachelors or Masters of Computer Science or related

Total years of experience - 6 to 13

Required Experience

• Must have experience in leading technical small to medium size teams.
• Full-Stack Software Development experience in both front end and back end technologies.
• Should be an outstanding programmer with 5 to 8 years of experience in PierianDx product-related technologies (e.g. AWS, Java, Spring Boot, Hibernate, microservices, Node.JS, React/Angular, SQL as well as No-SQL Databases, basics of Linux, Shell Scripting)
• Strong computer science fundamentals (OO programming, algorithms, data structures, databases).
• Experience with continuous integration infrastructure for software development such as Jenkins.
• Soft skills: Good Communication, Active listening, Influencing, Challenge self and team Experience with SQL and No-SQL Databases
• Demonstrated interpersonal skills including communication, mentoring, coaching, and the ability to interact with colleagues at all levels
• Dynamic, energetic, motivated, positive outlook.  Team player with good interpersonal skills
• Strong customer service and support focus with a desire to deliver a high-quality service
• Self-motivated and highly professional with the ability to lead and take ownership and responsibility
• Ability to multitask, work under pressure and to tight deadlines
• A desire to learn and improve skills and knowledge
• Adaptable and flexible to business demands
• Strong organisational and planning skill

Preferred Experince 

• Experience in developing software for medical devices (ISO 13485/IEC 62304)
• Experience with any Cloud Platform like AWS, GCP or Azure.
• Experience with Docker and anyone Container Orchestration Platforms like EKS, ECS, EKR, Kubernetes, Docker Swarm.
• Experience using Test Driven Development processes
• Experience working with FrontEnd Technologies (HTML, CSS, Javascript)
• Experience with MongoDB
• Experience with at least one dynamically typed language (Python, Node.js, Groovy).

Responsibilities

• Take ownership of providing technical support to the customer success team (for the issues they could not resolve in L1/L2). Examine potential areas for Service Improvement and recommend solutions/proposals to Product Management
• Work with Customer Success management and be aware of implementation projects and timelines; coordinate with project/program managers to plan and support release activities.
• Interact with internal and cross teams to troubleshoot and resolve complex problems. Develop, coordinate and promote the effective functioning of problem management activities across all of Pieriandx product & customer success teams.
• Provide technical leadership - Lead and prioritize the Application/Technical Support team’s workload. Guide team members to troubleshoot & resolve technical issues including software system design and maintenance.
• Contribute to the planning of application/infrastructure releases and configuration changes. Provide input to application/infrastructure scalability
• Design appropriate metrics for reporting on key performance and quality indicators, particularly in terms of in-depth trend analysis
• Maintain application by regular monitoring, performance tuning and testing activities
• Ensure compliance with SDLC processes defined at organization level to meet quality goals set at product level. Ensure there are robust procedures and processes within the application support function remit.
• Stay up-to-date on product and process training required to create quality deliverables at each phase of product life-cycle. Follow appropriate departmental and company procedures and policies (i.e. change control, security and auditing, release, configuration, problem and incident management).
• Maintain good working relationships with internal departments
• Design, prepare and conduct training relating to Problem & Incident Management
• Provide timely and expert advice on emerging trends and issues affecting Service Delivery and Support. Develop strategies to allow Application Support to manage resultant problems