Senior Data Engineer · Senior Cloud Engineer · Data Architect · AI Engineer
"Turning ideas into clean, maintainable systems — one reliable pipeline at a time." 💡
Senior Data Engineer and Data Architect, I have built a career over 10 years of experience in Data Engineering, Cloud Computing and Software Engineering.
My expertise is marked by Advanced SQL, Spark, Python, Apache Airflow, Astronomer, Databricks, DBT, BigQuery and Data Factory, along with multi-cloud providers such as Google Cloud, Azure, AWS, OCI and IBM Cloud.
I am proficient in a skill set spanning data orchestration, modeling and architecture, as well as project planning. My experience includes developing automated data pipelines (batch/streaming) and DevOps, applying the DataOps concept to create efficient deployment flows, combined with monitoring and observability practices (SRE).
I also develop scalable data solutions, focused on Data Strategy, Data Platform Engineering and the orchestration of Data Lakes, Data Mesh and Data Lakehouses. I am also focused on Machine Learning, AI and techniques for applying them to real-world situations.
I have extensive experience on global teams across the US and Europe, in various sectors and large companies such as Ford, CI&T, Cognizant and Mozilla. As a technical leader, I am responsible for guiding multidisciplinary teams, promoting technical excellence and collaboration.
- lab-cloud-cost-agents: Uso de Generative AI para criar sistema de análise de custos na nuvem em multi-cloud (Google Cloud e AWS)
- ia-agentes-diario-oficial-uniao: Agentes de IA para automação de processos para obter dados públicos do Diário Oficial da União do Brasil.
- log-generator-covid-vaccines-aws-kinesis: Acompanhamento das Vacinas de COVID-19 pelo mundo (em 2020).
⭐️ From zshgustavo
Let's connect, collaborate, and build the future of data together!