Data Engineer

Síntese de Qualificações

Data Engineer with 5 years of experience in developing, maintaining, and optimizing data solutions, and implementing processes to monitor data quality.
Highly experienced in developing and managing data ingestion pipelines.
Comfortable working with teams from all over the world.
Possess exceptional problem-solving skills and in-depth knowledge of data engineering principles and best practices.

Experiência Profissional

• Data Engineer - Arbit (3/2021 a 12/2022)

  Developed and maintained data ingestion pipelines for a global Big Tech company using Cloudera CDP, Python, Spark, and NiFi.
  
  Collaborated with teams from all over the world to deliver data projects.
  
  Monitored data quality and accuracy, and identified and resolved issues.
  
  Implemented data security and privacy measures to ensure compliance with regulations.

• Data Engineer - Semantix (9/2019 a 3/2021)

  Developed and maintained data pipelines using Cloudera Data Platform, Java, and Spark technologies.
  Implemented processes to monitor data quality, ensuring that production data is always accurate and available for analysis.
  
  Optimized data pipelines, resulting in improved data availability and accuracy.
  Built ETL jobs to transfer data from source systems to the data lake.
  Developed scripts to automate data quality checks.
  Worked with the data team to ensure data integrity across all systems.

• Java Software Engineer - Fiserv (9/2017 a 7/2019)

  Designed and developed a payment solution platform containing web services and API integration using Java, JEE, and Spring technologies.
  Collaborated with stakeholders to ensure that payment solutions met and exceeded customer expectations.

• Java Software Engineer - Cognizant (4/2015 a 9/2017)

  Designed and developed a payment solution platform containing web services and API integration using Java, JEE, and Spring technologies.

• Java Software Developer - FLEETCOR (3/2010 a 4/2015)

  Designed and implemented Java applications for the Benefits sector.
  Utilized various Java libraries and frameworks, such as Spring and Hibernate, to build secure and efficient applications.
  Collaborated with other developers on projects and provided technical support.
  Assisted in resolving technical issues and implementing bug fixes.

• Java Software Developer - Tata Consultancy Services (8/2009 a 11/2009)

  Developed web applications in the insurance sector utilizing Java, J2EE, and related technologies.

• Java Software Developer - Cleartech (8/2008 a 7/2009)

  Developed a web-based system for financial management and billing system using Java and J2EE for the telecom sector.

• Java Software Developer - Credit Suisse Hedging-Griffo (3/2007 a 7/2008)

  Developed financial web applications and web services using Java and J2EE for online private banking systems.

Formação Acadêmica

• Pós-graduação (9/2017 a 12/2018)

  Post-Graduate Degree in Big Data Analysis - FIA - Fundação Instituto de Administração

• Superior (1/2003 a 12/2004)

  Graduate degree in Information Systems - Faculdade Flamingo

Cursos e Certificações

Certificações:

Hadoop Foundations IBM
Reactive Architecture: Reactive Microservices
Lightbend, Inc. Scala Programming for Data Science IBM
Python for Data Science IBM
Spark IBM
Hadoop Administration IBM
Sun Certified Programmer for the Java 2 Platform, Standard Edition 5 - Sun Microsystems
Sun Certified Business Component Developer Java EE Platform 5 - Sun Microsystems
Oracle Certified Professional - Java EE 5 Web Component Developer - Oracle Microsoft Certified
Professional for Installing, Configuring, and Administering - Microsoft SQL Server 2000 Enterprise Edition Microsoft
Microsoft Certified Professional for Designing and Implementing Databases with - Microsoft SQL Server 2000 Enterprise Edition - Microsoft

Cursos:

AWS Certified Data Analytics - Specialty
AWS Certified Solutions Architect Associate
AWS Professional Services: Machine Learning on AWS
AWS Solutions Training for Partners: Foundations - Technical
Linear Regression Analysis
Apache Flink
Hadoop
Moving Data into Hadoop
Python for Data Science
Reactive Microservice
Scala
Advanced Spark
Spark Fundamentals I
Microsoft Azure for Data Engineering
Data Storage in Microsoft Azure
Data Integration with Microsoft Azure Data Factory
ETL and Data Pipelines with Airflow and Kafka
Microsoft Azure Databricks for Data Engineering

Conhecimentos Gerais

Java, JavaEE, Spring, Scala
Big Data, Hadoop, Apache Sqoop, Apache Flume, HBase,
Hibernate, EclipseLink, Struts
JSF, RichFaces, PrimeFaces, Javascript e AngularJS
Web Services, JAX-WS, SOAP, REST e JSON
Weblogic, JBoss, WildFly, Glassfish, Tomcat e Jetty
PL/SQL, Oracle, MySQL, MS SQL Server e PostgreSQL
Maven/Ant, Integração Contínua, Selenium e JUnit
UML, Scrum
CVS, SVN e Git
Windows, Mac OS e Linux