Brian Ly
I'm Brian
About
I'm a Cloud, Automation, and Big Data specialist with a passion for building efficient, scalable solutions. I have hands-on experience with cloud infrastructure tools like Azure, Terraform, Ansible, and Jenkins, helping automate complex workflows to boost performance and security. I’ve worked on exciting AI projects, including developing a chatbot with Azure OpenAI and creating analytics to optimize resource usage. My background also includes large-scale data migrations, setting up data governance with Unity Catalog, and designing Big Data architectures. I enjoy solving tough technical challenges, optimizing systems for performance, and building pipelines and web applications to streamline operations. Whether it's troubleshooting issues or driving innovation, I’m always focused on delivering impactful results.
Full-Stack Software Engineer with a focus on AI
Please contact me via LinkedIn if you would like to connect!
Skills
I am a passionate software engineer with expertise in full-stack development, cloud infrastructure, and AI-driven solutions. My skills include designing scalable systems, automating workflows, and building innovative applications to solve complex challenges.
Resume
Below is a summary of my experience in cloud infrastructure, automation, AI solutions, and data engineering, highlighting key projects and contributions that drive innovation and operational excellence.
Summary
Brian Ly
A skilled Cloud, Automation, and Big Data specialist with expertise in cloud infrastructure, AI-driven solutions, large-scale data migrations, and system optimization to deliver scalable and impactful results.
- Cloud, Automation, and Big Data Specialist: Extensive experience designing and provisioning cloud infrastructure using Microsoft Azure, Terraform, Ansible, and Jenkins, automating complex deployment and operations workflows to enhance scalability, performance, and security.
- AI and OpenAI Expertise: Involved in building an internal organizational chatbot leveraging Azure OpenAI Service, GPT-4o, and Azure AI Search with a custom front-end, while crafting OpenAI utilization reports using EventHub to monitor and optimize AI resource consumption.
- Data Engineering and Governance: Large-scale data migration projects from Cloudera HDP/HDF to Azure with tools like WANdisco, and provisioned Unity Catalog to enhance data governance, compliance, and centralized management across the organization.
- Analytics and Platform Engineering: Played a pivotal role in creating Big Data architectures for analytics products and automating routine operations for Hortonworks Data Platform (HDP) environments, while integrating new engineering tools through Proof of Concepts (PoC).
- Full-Stack Development and Productivity: Designed CI/CD solutions, crafted pipelines, and developed web applications using modern technologies, advocating for best practices in DevOps, cross-functional collaboration, and efficient development lifecycles.
- Systems Optimization and Performance: Performed systems upgrades, patching, and performance tuning across large-scale environments (700+ hosts), ensuring high reliability, stability, and operational efficiency for both cloud and Big Data platforms.
- Proactive Problem Solver: Acted as a trusted technical consultant and escalation point, providing expert support, troubleshooting cluster issues, and mitigating operational risks to ensure seamless project execution and platform availability.
Education
Bachelor of Engineering (B.Eng), Specialized Honours in Computer Engineering
2014 - 2019
Lassonde School of Engineering - York University, Toronto, Ontario
York’s program combines theoretical foundations in physical and computer science with practical system, software, and hardware engineering core concepts. Your studies in computation, software and hardware development, networks, operating systems and specialized fields such as robotics will prepare you to meet the challenges you will tackle during the senior Engineering Project or/and your placement in an elective industrial internship. This program shares its fundamental courses with the Computer Science program and adds additional courses in engineering design, electronics and computer hardware. York’s Computer Engineering program is accredited by the Canadian Engineering Accreditation Board (CEAB).
Bachelor of Science (B.Sc.), Kinesiology and Exercise Science
2010 - 2014
York University, Toronto, Ontario
Kinesiology and Health Science is the study of human movement and the relationship between physical activity and health. This exciting and innovative program at York University provides students the opportunity to pursue many sub-fields including physiology, anatomy, health, sport administration, health psychology, and athletic therapy in preparation for a career in health and rehabilitation, fitness, recreation, sports industries, research, or teaching.
Professional Experience
Senior Full-stack Software Engineer
Mar 2024 - Present
Manulife, Toronto, Ontario
- Contributed to the development of an internal chatbot using the GPT-4o model on Azure OpenAI Service, enabling intelligent, organization-wide communication and support.
- Integrated Azure AI Search and GPT models to provide enhanced natural language processing capabilities, improving the chatbot's ability to provide accurate responses to complex organizational queries.
- Designed and implemented an OpenAI utilization reporting solution, processing EventHub messages from API calls to extract insights and usage metrics, enabling data-driven decision-making regarding OpenAI resource management.
- Provisioned and configured Unity Catalog to centralize data governance and securely organize data assets, enhancing the organization’s ability to manage data access control and compliance.
- Developed CI/CD pipelines to automate Unity Catalog provisioning and streamline deployment processes, reducing manual effort and enabling faster iterations for data governance workflows.
- Collaborated with cross-functional developers to approve designs, optimize platform performance, and adhere to best practices for both front-end and back-end development.
Full-stack Software Engineer (Data)
Mar 2022 - Feb 2024
Manulife, Toronto, Ontario
- Designed and implemented Terraform infrastructure-as-code (IaC) solutions to automate the provisioning and management of a wide range of Azure resources, enabling project teams to scale efficiently.
- Developed robust code promotion scripts for Databricks environments and automated Azure ML pipeline promotion processes, streamlining model deployment workflows across environments.
- Engineered and optimized CI/CD pipelines in Jenkins, improving build and deployment efficiency for platform-related projects.
- Identified and mitigated operational risks, contributing to improved platform reliability, stability, and scalability.
- Collaborated cross-functionally with development and DevOps teams to establish best practices and drive continuous improvements in automation and platform support
Services
I offer a range of professional services tailored to meet your needs, including full-stack software development, cloud infrastructure design, AI-driven solutions, and data engineering. My expertise lies in creating scalable, efficient, and innovative solutions to help businesses achieve their goals.
Consultant Services
I provide expert consulting services in cloud infrastructure, AI-driven solutions, and full-stack development. With a focus on scalability, efficiency, and innovation, I help businesses design and implement tailored solutions to meet their unique challenges and goals.
Software Development
I bring extensive experience in full-stack software development, specializing in building scalable, user-friendly applications. From crafting intuitive front-end interfaces to architecting robust back-end systems, I deliver end-to-end solutions tailored to meet business needs. My expertise includes modern frameworks, cloud integration, and CI/CD pipelines to ensure efficient and seamless deployments.
AI Expertise
I provide AI expertise services, including developing intelligent chatbots, integrating AI-driven solutions into existing systems, and optimizing AI resource utilization. My experience spans natural language processing, machine learning, and data-driven insights, enabling businesses to harness the power of AI for innovation and efficiency.
Cloud Platform Expertise
I provide expert services in cloud platform design and management, specializing in Microsoft Azure. With extensive experience in provisioning scalable infrastructure, automating workflows using tools like Terraform and Ansible, and optimizing cloud environments for performance and security, I help businesses achieve operational excellence and innovation.
Leadership & Management
I offer leadership and management services to guide teams toward achieving their goals efficiently and effectively. With a focus on fostering collaboration, driving innovation, and ensuring project success, I help organizations build strong, motivated teams and deliver impactful results.
Technical Project Management
I provide technical project management services to ensure seamless execution of complex projects. With expertise in coordinating cross-functional teams, managing timelines, and delivering scalable solutions, I help organizations achieve their goals efficiently and effectively.
Testimonials
Below are some AI-generated testimonials showcasing the impact of my work and the value I bring to projects. These testimonials highlight my expertise in software engineering, cloud infrastructure, and AI-driven solutions.
Working with Brian was an absolute pleasure. As a project manager, I was consistently impressed by his expertise in AI development and his ability to deliver innovative solutions. His proactive approach, attention to detail, and collaborative spirit made him an invaluable asset to our team. Brian's work not only met but exceeded our expectations, and I would highly recommend him for any AI-driven project.
Nathan Harrison
Project Manager
Brian is an exceptional collaborator with outstanding communication skills. As a UX/UI designer, I truly appreciated his ability to clearly articulate technical concepts and ensure alignment across teams. His proactive approach and willingness to listen made our design-development process seamless and efficient. Brian's expertise and teamwork were instrumental in delivering a user-friendly and visually appealing product.
Sarah Wu
UI/UX Designer
Brian is an incredibly hardworking and reliable professional. As a business analyst, I was consistently impressed by his ability to deliver high-quality work on time, even under tight deadlines. His dedication, attention to detail, and commitment to excellence ensured the success of our projects. Brian's collaborative approach and technical expertise made him an invaluable asset to our team, and I would highly recommend him for any challenging endeavor.
Jena Page
Business Analyst
Brian is an exceptional developer with a deep understanding of both front-end and back-end technologies. Working alongside him has been a rewarding experience as he consistently brings innovative solutions to complex problems. His collaborative nature and willingness to mentor others make him a valuable team member. I highly recommend Brian for any challenging development projects.
Matt Brandon
AI Developer
Brian's expertise in data engineering and AI integration is unparalleled. As a data scientist, I relied heavily on his ability to design scalable pipelines and optimize data workflows. His innovative solutions and collaborative approach significantly enhanced our team's productivity and enabled us to deliver impactful insights. Brian is a true professional and a pleasure to work with.
John Larson
Data Scientist
Contact Me
Feel free to connect through the contact information below for professional inquiries or collaboration opportunities.