• Currently handling the big data vertical of the company which includes pre-sales, current projects and maintenance of projects.
• Heading the big data applications for the company and managing different teams collaboratively to achieve high efficiency solutions for clients.
• Mostly involved from the beginning of the application from scratch till the end of the projects.
• Currently started working on building an application which integrates all the data from source systems using Hadoop.
• All data is ingested from other systems into Hive tables using Sqoop.
• All data transformations and processing happens in Spark on Hive tables including lot of joins on different entities partitioned by date.
• This data will later be used to generate reports and analytics purposes. 

Lead a team of developers and developed new features in the product called 'Cortellis Data Fusion'.

• Handled this big product which was originally developed by Thomson Reuters, then we developed features in it under a major US Pharma client.
• The product fetches data from all data sources of the company and make relations between them in the form of graphs. Finally when the users search anything, it gives a final analysis of all the relations that item has from the information it gathered from all the data sources.
• The technologies used are Groovy with Grails, Java, Solr, Accumulo, Hadoop, PostGres, ExtJS, Gradle, HDFS etc. 

Developed a Java application with searching capabilities and web-services single handedly.

• The project was to develop middle-tier Java Web Services that can query elastic search index for real time searching.
• Used Java Rest Web Service to add, search, delete and update the indexes in elastic search.
• Installed and Setup Elastic Search from scratch and setup indexes and mappings for operations. 

The project was to ingest data from around 30 applications into our application and export the data to Teradata application for reporting purposes.

• Used Hive, Java & Pig for end-to-end development of different data topics into different layers of application.
• Used Pig to process the clickstream logs data.
• Design workflows for java, hive and pig scripts in oozie.
• Use Falcon feeds & processes for triggering workflows on basis of data availability.
• Writing different UDFs for adding extra fields as surrogate keys in the data to uniquely identify rows, etc and used Cassandra for mapping of these transactions.
• Worked on Avro and Json data formats.
• Installed & configured Kerberos for HDFS taking the security to another level.
• Installation & configured Encrypted HDFS cluster. 

The project was for doing ETL insurance transactions from various systems daily.

• My role was to identify and automate technical processes.
• Within 2 months, analyzed the pain point for the client and gave an idea of Automation and also implemented it single-handedly.
• I wrote the Automation Application in Java which extracts all the xml files from a big file and then extracts the values of each xml, and compares and validates with the source file and writes its decisions into a new excel file with formatting also automated.

The aim of the project was to remediate the customers who did not get bonus but are eligible for it. So analysis is done on their transactions and their bonus is calculated and implemented manually.

• Having experience in Importing and Exporting data to HDFS using SQOOP.
• Installation and running of different components of Hadoop.
• Involved in creating hive tables with partitions and bucketing.
• Capable of processing large data that is Data Extraction, Transformation and Data Loading in Data Warehouse environment.
• Executed queries using Pig to analyze data to solve problems.
• Hands on experience in joining tables, grouping fields, filtering records.
• Developed Pig & Hive UDFs for gaining more control over the process of data.
• Worked on Analytical Functions like lead, lag, rank etc.
• Good knowledge of MapR Framework & HDFS Architecture.