Brian Ly

I'm Brian

About

I'm a Cloud, Automation, and Big Data specialist with a passion for building efficient, scalable solutions. I have hands-on experience with cloud infrastructure tools like Azure, Terraform, Ansible, and Jenkins, helping automate complex workflows to boost performance and security. I’ve worked on exciting AI projects, including developing a chatbot with Azure OpenAI and creating analytics to optimize resource usage. My background also includes large-scale data migrations, setting up data governance with Unity Catalog, and designing Big Data architectures. I enjoy solving tough technical challenges, optimizing systems for performance, and building pipelines and web applications to streamline operations. Whether it's troubleshooting issues or driving innovation, I’m always focused on delivering impactful results.

Full-Stack Software Engineer with a focus on AI

Please contact me via LinkedIn if you would like to connect!

Cloud, Automation, and Big Data Specialist: Extensive experience designing and provisioning cloud infrastructure using Microsoft Azure, Terraform, Ansible, and Jenkins, automating complex deployment and operations workflows to enhance scalability, performance, and security.

AI and OpenAI Expertise: Involved in building an internal organizational chatbot leveraging Azure OpenAI Service, GPT-4o, and Azure AI Search with a custom front-end, while crafting OpenAI utilization reports using EventHub to monitor and optimize AI resource consumption.

Data Engineering and Governance: Large-scale data migration projects from Cloudera HDP/HDF to Azure with tools like WANdisco, and provisioned Unity Catalog to enhance data governance, compliance, and centralized management across the organization.

Analytics and Platform Engineering: Played a pivotal role in creating Big Data architectures for analytics products and automating routine operations for Hortonworks Data Platform (HDP) environments, while integrating new engineering tools through Proof of Concepts (PoC).

Full-Stack Development and Productivity: Designed CI/CD solutions, crafted pipelines, and developed web applications using modern technologies, advocating for best practices in DevOps, cross-functional collaboration, and efficient development lifecycles.

Systems Optimization and Performance: Performed systems upgrades, patching, and performance tuning across large-scale environments (700+ hosts), ensuring high reliability, stability, and operational efficiency for both cloud and Big Data platforms.

Proactive Problem Solver: Acted as a trusted technical consultant and escalation point, providing expert support, troubleshooting cluster issues, and mitigating operational risks to ensure seamless project execution and platform availability.

Happy Clients consequuntur quae

Projects adipisci atque cum quia aut

Hours Of Support aut commodi quaerat

Hard Workers rerum asperiores dolor

Skills

Necessitatibus eius consequatur ex aliquid fuga eum quidem sint consectetur velit

HTML 100%

CSS 90%

JavaScript 75%

PHP 80%

WordPress/CMS 90%

Photoshop 55%

Resume

Below is a summary of my experience in cloud infrastructure, automation, AI solutions, and data engineering, highlighting key projects and contributions that drive innovation and operational excellence.

Summary

Brian Ly

A skilled Cloud, Automation, and Big Data specialist with expertise in cloud infrastructure, AI-driven solutions, large-scale data migrations, and system optimization to deliver scalable and impactful results.

Cloud, Automation, and Big Data Specialist: Extensive experience designing and provisioning cloud infrastructure using Microsoft Azure, Terraform, Ansible, and Jenkins, automating complex deployment and operations workflows to enhance scalability, performance, and security.
AI and OpenAI Expertise: Involved in building an internal organizational chatbot leveraging Azure OpenAI Service, GPT-4o, and Azure AI Search with a custom front-end, while crafting OpenAI utilization reports using EventHub to monitor and optimize AI resource consumption.
Data Engineering and Governance: Large-scale data migration projects from Cloudera HDP/HDF to Azure with tools like WANdisco, and provisioned Unity Catalog to enhance data governance, compliance, and centralized management across the organization.
Analytics and Platform Engineering: Played a pivotal role in creating Big Data architectures for analytics products and automating routine operations for Hortonworks Data Platform (HDP) environments, while integrating new engineering tools through Proof of Concepts (PoC).
Full-Stack Development and Productivity: Designed CI/CD solutions, crafted pipelines, and developed web applications using modern technologies, advocating for best practices in DevOps, cross-functional collaboration, and efficient development lifecycles.
Systems Optimization and Performance: Performed systems upgrades, patching, and performance tuning across large-scale environments (700+ hosts), ensuring high reliability, stability, and operational efficiency for both cloud and Big Data platforms.
Proactive Problem Solver: Acted as a trusted technical consultant and escalation point, providing expert support, troubleshooting cluster issues, and mitigating operational risks to ensure seamless project execution and platform availability.

Education

Bachelor of Engineering (B.Eng), Specialized Honours in Computer Engineering

2014 - 2019

Lassonde School of Engineering - York University, Toronto, Ontario

York’s program combines theoretical foundations in physical and computer science with practical system, software, and hardware engineering core concepts. Your studies in computation, software and hardware development, networks, operating systems and specialized fields such as robotics will prepare you to meet the challenges you will tackle during the senior Engineering Project or/and your placement in an elective industrial internship. This program shares its fundamental courses with the Computer Science program and adds additional courses in engineering design, electronics and computer hardware. York’s Computer Engineering program is accredited by the Canadian Engineering Accreditation Board (CEAB).

Bachelor of Science (B.Sc.), Kinesiology and Exercise Science

2010 - 2014

York University, Toronto, Ontario

Kinesiology and Health Science is the study of human movement and the relationship between physical activity and health. This exciting and innovative program at York University provides students the opportunity to pursue many sub-fields including physiology, anatomy, health, sport administration, health psychology, and athletic therapy in preparation for a career in health and rehabilitation, fitness, recreation, sports industries, research, or teaching.

Professional Experience

Senior Full-stack Software Engineer

Mar 2024 - Present

Manulife, Toronto, Ontario

Contributed to the development of an internal chatbot using the GPT-4o model on Azure OpenAI Service, enabling intelligent, organization-wide communication and support.
Integrated Azure AI Search and GPT models to provide enhanced natural language processing capabilities, improving the chatbot's ability to provide accurate responses to complex organizational queries.
Designed and implemented an OpenAI utilization reporting solution, processing EventHub messages from API calls to extract insights and usage metrics, enabling data-driven decision-making regarding OpenAI resource management.
Provisioned and configured Unity Catalog to centralize data governance and securely organize data assets, enhancing the organization’s ability to manage data access control and compliance.
Developed CI/CD pipelines to automate Unity Catalog provisioning and streamline deployment processes, reducing manual effort and enabling faster iterations for data governance workflows.
Collaborated with cross-functional developers to approve designs, optimize platform performance, and adhere to best practices for both front-end and back-end development.

Full-stack Software Engineer (Data)

Mar 2022 - Feb 2024

Manulife, Toronto, Ontario

Designed and implemented Terraform infrastructure-as-code (IaC) solutions to automate the provisioning and management of a wide range of Azure resources, enabling project teams to scale efficiently.
Developed robust code promotion scripts for Databricks environments and automated Azure ML pipeline promotion processes, streamlining model deployment workflows across environments.
Engineered and optimized CI/CD pipelines in Jenkins, improving build and deployment efficiency for platform-related projects.
Identified and mitigated operational risks, contributing to improved platform reliability, stability, and scalability.
Collaborated cross-functionally with development and DevOps teams to establish best practices and drive continuous improvements in automation and platform support

Portfolio

Magnam dolores commodi suscipit. Necessitatibus eius consequatur ex aliquid fuga eum quidem. Sit sint consectetur velit. Quisquam quos quisquam cupiditate. Et nemo qui impedit suscipit alias ea. Quia fugiat sit in iste officiis commodi quidem hic quas.

All
App
Product
Branding
Books