Senior Python Data Engineer - VP (Hybrid)
Senior Python Data Engineer - VP (Hybrid)
Job Description
We are looking to hire experienced Data Engineer to join our team responsible for building technology solutions for the Markets Business Controls Technology and for various business risk and controls functions. You will work with the Architects, Business stakeholders and Data Scientists to ensure we are meeting their requirements to develop and drive automation. This is an exciting opportunity to work on an important project for the group, which will have huge impact on the business and future design in this area.
Key Responsibilities:
- Evaluate and provide technical solutions to solve a variety of complex and interdependent processes
- Develop and automate large scale, high performance data processing systems(batch and Real Time) to drive growth and improve product experience
- Develop and maintain infrastructure tooling for our data systems
- Collaborate with software teams and business analysts to understand their data requirements and deliver quality fit for purpose data solutions
- Ensure data quality and accuracy by implementing data quality checks, data contracts and data governance processes
- Contribute to the ongoing development of our data architecture and data governance capabilities
- Develop and maintain data models and data dictionaries
- Serve as advisor and coach to junior members of the team
- Identify problems, analyse information, and make evaluative judgements to recommend and implement solutions
- Acts as SME to senior stakeholders and/or other team members
- Evaluate and perform POC's on new strategic technical products and applications and it's applicability to the strategic platform
Skills & Experience :
- Significant professional experience in Data engineering, ETL processing and Data Warehousing
- Commercial exposure on development using PySpark/Spark, particularly on data processing and the associated modules
- Work exposure on Kubernetes/Red Hat OpenShift
- Experience working with Open table/storage formats like delta lake, Apache Iceberg or Apache Hudi
- Have worked on Delta Lake and exposure on consuming Real Time messages via Kafka
- Experience on Unix, HDFS and supported libraries such as PyArrow. PySpark experience is preferred as the environment uses Hadoop and Spark
- Professional working knowledge of Databases (SQL/NoSQL)
- Working knowledge of BitBucket or equivalent SCM tool
- Knowledge of Apache Airflow is desirable
- Ability to work collaboratively in teams and develop meaningful relationships to achieve common goals
- Ability to multi-task and deliver to a tight deadline
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
What we'll provide you
By joining Citi London, you will not only be part of a business casual workplace with a hybrid working model (up to 2 days working at home per week), but also receive a competitive base salary (which is annually reviewed), and enjoy a whole host of additional benefits such as:
- 27 days annual leave (plus bank holidays)
- A discretional annual performance related bonus
- Private Medical Care & Life Insurance
- Employee Assistance Program
- Pension Plan
- Paid Parental Leave
- Special discounts for employees, family, and friends
- Access to an array of learning and development resources
Visit our Global Benefits page to learn more.
Alongside these benefits Citi is committed to ensuring our workplace is where everyone feels comfortable coming to work as their whole self, every day. We want the best talent around the world to be energized to join us, motivated to stay and empowered to thrive.
Job Family Group:
TechnologyJob Family:
Applications DevelopmentTime Type:
Full timeCiti is an equal opportunity and affirmative action employer.
Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Citigroup Inc. and its subsidiaries ("Citi") invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi .
View the " EEO is the Law " poster. View the EEO is the Law Supplement .
View the EEO Policy Statement .
View the Pay Transparency Posting