Harsh Joshi

Key Responsibilities :

• Fine-tuned data pipelines for increased efficiency.
• Crafted complex scripts in Python for data processing and analysis.
• Generated comprehensive analysis reports using Microsoft Office.
• Orchestrated seamless data workflows using Azure Data Factory.
• Conducted rigorous data-driven tests using SQL to ensure data integrity.
• Executed projects and tasks seamlessly with strong time management skills.
• Led optimization of ETL processes with Apache Spark and Azure Databricks.
• Managed streaming and batch data through Delta Live Tables in Azure Databricks.
• Embraced DevOps practices and proficiently managed pipelines to foster efficient development cycles.
• Developed interactive data visualizations using Power BI to support business insights and decision-making.

Key Responsibilities :

• Developed and implemented various Machine Learning Components, including Model Metrics Evaluation, Data Analyzer, Model Executor, and Model Ensemble.
• Constructed Docker images for seamless deployment, showcasing proficiency in orchestrating robust and scalable solutions.
• Demonstrated expertise in Entity Extraction from both Structured and Unstructured Data, efficiently processing complex datasets to extract relevant information.
• Leveraged Knowledge Graphs to develop predictive models for task assignments, enhancing decision-making by predicting optimal teams of individuals for specific tasks.
• Created insightful analysis reports and maintained effective communication with lab researchers, fostering collaboration and knowledge sharing within multidisciplinary teams.

Key Responsibilities :

• Conducted comprehensive analyses of products, services, markets, and advertising opportunities using data on customers, competitors, and marketing channels.
• Utilized Crystal Reports to summarize and analyze data on homeless individuals collected by The Housing Collective across the United States.
• Translated complex data sets into impactful presentations and actionable intelligence, supporting informed decision-making.
• Created interactive and visually compelling dashboards using Power BI to effectively represent data and facilitate insights.
• Implemented data management strategies, including removing unused data and filtering, resulting in a 50% improvement in database efficiency.
• Designed and implemented efficient data flow processes, achieving a 60% increase in streaming efficiency for real-time data analysis.
• Applied statistical techniques and data mining algorithms to identify trends and patterns, supporting data-driven strategies.
• Collaborated with cross-functional teams to extract and communicate relevant insights from data, enhancing decision-making processes.

Key Responsibilities :

• Provided leadership and engaged with the team within agile methodologies, offering and receiving feedback on design to ensure alignment with business requirements and adherence to industry standards.
• Designed and maintained high-performance ELT/ETL processes, incorporating advanced predictive analytics techniques such as machine learning and data mining, achieving a 95% accuracy rate in output forecasting.
• Mentored junior team members, ensuring adherence to coding standards and fostering a collaborative work environment.
• Automated data processing tasks using Python and libraries like Pandas and Beautiful Soup, significantly enhancing efficiency.
• Led teams within agile methodologies to effectively align applications with business needs and manage critical ingestion pipelines.
• As a Data Architect, designed and maintained high-performance ELT/ETL processes, integrating predictive analytics techniques for accurate forecasting.
• Generated comprehensive management data reports and presented key insights to executive stakeholders.
• Implemented strategic initiatives for redesigning and developing critical ingestion pipelines, facilitating the smooth processing of large volumes of data and showcasing innovative solutions to complex data challenges.

Key Responsibilities :

• Spearheaded the establishment of high-availability data infrastructure, resulting in a 90% increase in data availability and ensuring uninterrupted access to critical business data.
• Developed a robust data monitoring and alerting system to proactively identify and resolve production issues, mitigating potential impacts on business operations.
• Implemented a reproducible data pipeline, reducing delivery time by 60% and streamlining insights delivery to stakeholders.
• Designed and enforced best practices for continuous process automation in data ingestion and pipeline workflows, enhancing operational efficiency.
• Led the design and development of logical and physical Data Models and authored PL/SQL code for data conversion in the Clearance Strategy Project, showcasing expertise in data architecture and conversion methodologies.
• Collaborated with Development and QA teams to institute a build schedule and address data quality issues, utilizing Regular Expression codes for data parsing.
• Managed the entire software development life cycle, from design and documentation to implementation, testing, and deployment, including designing table structures and reporting formats for global reports.
• Enhanced visualization for customers and development team contractors through well-designed reporting formats.
• Orchestrated comprehensive testing cycles, including Functional Testing, System Integration Testing, Database Testing, Regression Testing, and User Acceptance Testing.