Senior Data Engineer I

Location

Chennai, Tamil Nadu

Full job description

You Lead the Way. We’ve Got Your Back.

With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, you’ll learn and grow as we help you create a career journey that’s unique and meaningful to you with benefits, programs, and flexibility that support you personally and professionally.

At American Express, you’ll be recognized for your contributions, leadership, and impact—every colleague has the opportunity to share in the company’s success. Together, we’ll win as a team, striving to uphold our company values and powerful backing promise to provide the world’s best customer experience every day. And we’ll do it with the utmost integrity, and in an environment where everyone is seen, heard and feels like they belong.

Join Team Amex and let's lead the way together.

As part of our diverse tech team, you can architect, code and ship software that makes us an essential part of our customers’ digital lives. Here, you can work alongside talented engineers in an open, supportive, inclusive environment where your voice is valued, and you make your own decisions on what tech to use to solve challenging problems. Amex offers a range of opportunities to work with the latest technologies and encourages you to back the broader engineering community through open source. And because we understand the importance of keeping your skill fresh and relevant, we give you dedicated time to invest in your professional development. Find your place in technology on #TeamAmex.

How will you make an impact in this role?

The Infrastructure Data & Analytics team unifies FinOps, Data Science and Business Intelligence to enable Technology cost transparency, infrastructure performance optimization and commercial efficiency for the enterprise through consistent, high-quality data and predictive analytics. This team within Global Infrastructure aims to establish and reinforce a culture of effective metrics, data-driven business processes, architecture simplification, and cost awareness. Metric-driven cost optimization, workload-specific forecasting and robust contract management are among the tools and practices required to drive accountability for delivering business solutions that derive maximum value. The result will provide a solid foundation for decision-making around cost, quality and speed.

We are seeking an experienced Senior Data Engineer for our team who can lead the design, development and enhancement of our data model and architecture. This team sets the foundation for how infrastructure utilization, consumption and asset inventory data is ingested, validated, and presented in our suite of reporting capabilities. The Sr. Data Engineer will help ensure data quality (data accuracy, completeness, timeliness, consistency, uniqueness and relevance) is meeting the highest standards for our users. This individual will be responsible for implementing our target data architecture, leveraging best practices for data management, automating data feeds and transformations, and maintaining excellent documentation.

Let’s build on what you know.

The role will require a unique blend of strong data ops technical and design skills to translate business decisions into data requirements. This individual will build a deep understanding of the infrastructure data we use in order to work across the ID&A team and key stakeholders the appropriate data to tell a data story. This includes implementing and maintaining a data architecture that follows data management best practices for ensuring data ingestion, transformation, storage and analytics are handled according to their specific purpose using the appropriate tools: ingestion captures raw data without applying business logic, transformation processes data discretely for auditability, and analytical queries retrieve structured outputs without relying on upstream processes. They will bring passion for data-driven decisions, enterprise solutions, and collaboration to the role, transforming platform data into actionable insights by utilizing data engineering and data visualization best practices.

Key responsibilities include:

Data Architecture: Perform all technical aspects of data architecture and database management for ID&A, including developing data pipelines, new database structures and APIs as applicable
Data Design: Translate logical data architectures into physical data designs, ensuring alignment with data modeling best practices and standards
Data Process and Monitoring: Ensure proper data ingestion, validation, testing, and monitoring for ID&A data lake
Support database and data platform administration for initiatives building, enhancing, or maintaining databases, data warehouses and data pipelines
Data Migration: Design and support migration to a data model that is independent of the particular technologies or tools used for storing, processing, or accessing the data
Data Integrity: Ensure the accuracy, completeness, and quality of data is maintained over time regardless of upstream systems or downstream
Agile Methodologies: Function as a senior member of an agile feature team and manage data assets as per the enterprise standards, guidelines and policies
Partner closely with business intelligence team to capture and define data requirements for new and enhanced data visualizations
Work with product teams to prioritize new features for ongoing sprints and manage backlog
Enterprise Thinking: Partner with data architects and engineers across Global Infrastructure and Asset Management teams to evolve the broader tech operations data architecture landscape
Mentor junior data engineers through ongoing development efforts and enforcement of SDLC standards
Act as point of contact for data-related inquiries and data access requests
Contribute to decisions about tools, methods and approaches
Innovation: Leverage the evolving technical landscape as needed, including AI, Big Data, Machine Learning and other technologies to deliver meaningful business insights

Minimum Requirements:

8+ years of DataOps engineering experience in implementing pipeline orchestration, data quality monitoring, governance, security processes, and self-service data access
Experience managing databases, ETL/ELT pipelines, data lake architectures, and real-time processing
Proficiency in API development and stream processing frameworks
Hands-on coding experience in Python
Hands-on expertise with design and development across one or more database management systems (e.g. SQL Server, PostgreSQL, Oracle)
Testing and Troubleshooting: Ability to test, troubleshoot, and debug data processes
Strong analytical skills with a proven ability to understand and document business data requirements in complete, accurate, extensible and flexible logical data models, data visualization tools (e.g. Apptio BI, PowerBI)
Ability to write efficient SQL queries to extract and manipulate data from relational databases, data warehouses and batch processing systems
Fluent in data risk, management, and compliance terminology and best practices
Proven track record for managing large, complex ecosystems with multiple stakeholders
Self-starter who is able to problem-solve effectively, organize and document processes, and prioritize feature with limited guidance
An enterprise mindset that connects the dots across various requirements and the broader operations/infrastructure data architecture landscape
Excellent influential and collaboration skills; ability to drive consensus and tangible outcomes, demonstrated by breaking down silos and fostering cross-team communication
Understanding of complex software delivery including build, test, deployment, and operations; conversant in AI, Data Science, and Business Intelligence concepts and technology stack
Foundational Public Cloud (AWS, Google, Microsoft) certification; advanced Public Cloud certifications a plus
Experience working in technology business management, technology infrastructure or data visualization teams a plus
Experience with design and coding across multiple platforms and languages a plus
Bachelor’s Degree in computer science, computer science engineering, data engineering, or related field required; advanced degree preferred

We back you with benefits that support your holistic well-being so you can be and deliver your best. This means caring for you and your loved ones' physical, financial, and mental health, as well as providing the flexibility you need to thrive personally and professionally:

Competitive base salaries
Bonus incentives
Support for financial-well-being and retirement
Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location)
Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
Generous paid parental leave policies (depending on your location)
Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
Free and confidential counseling support through our Healthy Minds program
Career development and training opportunities

American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law.

Offer of employment with American Express is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.

Location

Full job description

Related Jobs