- Bengaluru, IN
- $12 /hr
- Available now
• Having 12 years of extensive experience in the field of Information Technology in developing large-scale Data warehouse, Data Integration, Data Migration and ETL processes usingmore...• Having 12 years of extensive experience in the field of Information Technology in developing large-scale Data warehouse, Data Integration, Data Migration and ETL processes using Datastage, Talend, Hadoop-eco system and Spark.
• In depth understanding/knowledge of Hadoop framework and Spark framework
• Experience in working with Hadoop Ecosystems like HDFS, Sqoop, Hive, Pig and Oozie.
• Experience in importing and exporting Tera bytes of data between HDFS and RDBM Systems (Oracle, DB2, and Teradata) using Sqoop.
• Extensive experience in developing Hive jobs and PIG Latin Scripts to transform stored data and existing SQL queries based on business requirements for data analytics.
• Hands on experience on SPARK components like Spark core, Spark SQL and Spark Streaming
• Effectively used Oozie to develop automatic workflows of Sqoop, Hive, PIG and Spark jobs.
• Extensively used ETL methodology for performing Data Extraction, Data Migration, Data Integration, Transformation and Loading using Talend.
• Designed data conversions from wide variety of source systems including Oracle, DB2, SQL server, Hive, flat files, XML, Mainframe Files and APIs in Talend.
• Experience in creating Joblets, Routines, Pattern based integration solutions in Talend.
• Experienced in Talend Admin Center for deployment, scheduling & monitoring of Talend jobs.
• Core expertise in Consulting and Solutioning of Data Integration and Data Migrations for SAP and non-SAP application systems using IBM Infosphere DataStage.
• Used Datastage plug-in for integration with SAP (BAPI,ABAP Extract, BW Extract, BW Load and