47 jobs for you
Unilever
2,000.00 - 2,050.00/Month
Psybergate (Pty) Ltd
20,000.00 - 35,000.00/Month
BayPort
31,000.00 - 32,000.00/Month
Psybergate (Pty) Ltd
20,000.00 - 40,000.00/Month
Unilever
1,950.00 - 2,000.00/Month
Unilever
2,000.00 - 2,050.00/Month
Unilever
2,100.00 - 2,150.00/Month
Main Job Purpose Senior Data Engineer will provide technical data leadership in our I&A team. You will be responsible for creating, expanding, optimising and managing our data depositary warehouse and data pipeline architecture, as well as optimising data flow and collection. This role will support our data initiatives and will ensure optimal data delivery architecture is consistent throughout the organisation and ongoing projects. Main Accountabilities • * Be the expert in UL Data, current and future • * Create and maintain optimal data pipeline architecture to balance performance and cost • * Assemble large, complex data sets that meet functional / non-functional business requirements. • * Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, refactoring current architecture, data governance Inc. lineage, catalog and quality. • * Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Data Warehousing, PySpark/Spark, Python and Cloud technologies. • * Work with software engineering best practices such as version control, continuous integration and test driven development including Azure Dev Ops and Git. • * Work with MS Azure including Databricks (Pyspark and Delta Lake), Data Factory, Dev Ops, ADLS, Blob Storage and Power BI Datasets • * Use of advanced SQL skills and an understanding of query and storage optimisation • * Ensure that deliverables meet or exceed functional, technical and performance requirements • * Contribute to the development of your own and team’s technical acumen • * Continuous learning of new tools & technologies via external sources that brings direct value to the business Experience And Qualifications Needed Standards of Leadership Required in This Role • * Personal Mastery • * Agility • * Passion for High Performance • * Business Acumen
Create a new Job Alert to make sure you see the best new jobs first!
Remember: You should never send cash or cheques to a prospective employer, or provide your bank details or any other financial information. We pay great attention to vetting all jobs that appear on our site, but please get in touch if you see any roles asking for such payments or financial details from you. For more information on conducting a safe job hunt online, visit fratres.net
Unilever
2,000.00 - 2,050.00/Month