https://engineering-leadership.hinshelwood.com/tags/experimentation/ Recent content in Experimentation on Engineering Leadership in AI & Software Hugo en Tue, 16 Jun 2026 17:40:35 +0000 https://engineering-leadership.hinshelwood.com/videos/from-legacy-pain-to-modern-devops-my-proven-roadmap-for-real-engineering-transformation/ Mon, 04 Aug 2025 07:00:00 +0000 https://engineering-leadership.hinshelwood.com/videos/from-legacy-pain-to-modern-devops-my-proven-roadmap-for-real-engineering-transformation/ Transforming legacy engineering to modern DevOps requires a flexible, evidence-based approach focused on testing hypotheses, starting with the most challenging products, and automating every step from code commit to production. Involve all stakeholders to define essential requirements, automate approvals and deployments, and use phased rollouts with real-time feedback to minimize risk. Focus on one improvement at a time, build a culture of continuous learning, and scale successful practices across the organization. https://engineering-leadership.hinshelwood.com/articles/testing-in-production-maximises-quality-and-value/ Thu, 13 Feb 2025 09:00:00 +0000 https://engineering-leadership.hinshelwood.com/articles/testing-in-production-maximises-quality-and-value/ Testing in production using audience-based deployment enables faster feedback, safer incremental releases, and better alignment with real user needs compared to traditional Dev-Test-Staging pipelines. Microsoft’s shift to this model, driven by feature flags, progressive rollouts, and real-time monitoring, has improved quality and innovation while reducing risk and overhead. Development managers should consider moving away from environment-based branching and invest in automation, observability, and team upskilling to maximise value and responsiveness. https://engineering-leadership.hinshelwood.com/videos/maximising-product-value-the-power-of-hypothesis-driven-engineering/ Wed, 11 Dec 2024 06:30:00 +0000 https://engineering-leadership.hinshelwood.com/videos/maximising-product-value-the-power-of-hypothesis-driven-engineering/ Focusing on hypothesis-driven engineering helps teams maximise product value by testing ideas with small experiments, measuring outcomes, and quickly adapting based on real customer feedback. The Azure DevOps team’s experience showed that even costly initiatives can provide critical learning, allowing resources to be redirected before larger losses occur. Development managers should encourage rapid experimentation and validation at all levels to ensure investments deliver real value and support agility. https://engineering-leadership.hinshelwood.com/guides/evidence-based-management-guide/ Wed, 01 Jan 2020 00:00:00 +0000 https://engineering-leadership.hinshelwood.com/guides/evidence-based-management-guide/ Evidence-Based Management (EBM) guides organisations to improve value delivery under uncertainty by using empirical goals, measurement, and continuous experimentation. https://engineering-leadership.hinshelwood.com/videos/the-importance-of-validation-in-product-development-a-strategic-approach/ Mon, 02 Sep 2024 15:30:15 +0000 https://engineering-leadership.hinshelwood.com/videos/the-importance-of-validation-in-product-development-a-strategic-approach/ Prioritizing features to close sales can fragment your product and lead to long-term costs that outweigh short-term gains. Shifting to a hypothesis-driven approach, where you define, track, and validate the value of new features using data, helps ensure you invest in what truly benefits users and the business. Equip product managers with the right telemetry and authority to make evidence-based decisions, and avoid building features that do not deliver measurable value. https://engineering-leadership.hinshelwood.com/videos/harnessing-the-power-of-empiricism-transform-your-decision-making-with-data-driven-insights/ Thu, 17 Aug 2023 07:00:09 +0000 https://engineering-leadership.hinshelwood.com/videos/harnessing-the-power-of-empiricism-transform-your-decision-making-with-data-driven-insights/ Using data to guide decisions helps teams make better choices, improve continuously, and build trust with stakeholders. The key is to ensure access to relevant data, act deliberately, and monitor results in a cycle of experimentation and learning. Development managers should foster a culture where decisions are based on evidence, not assumptions, and regularly review outcomes to adapt and improve. https://engineering-leadership.hinshelwood.com/videos/transforming-agile-training-into-action-experimentation-and-engagement-in-the-workplace/ Mon, 24 Apr 2023 07:00:03 +0000 https://engineering-leadership.hinshelwood.com/videos/transforming-agile-training-into-action-experimentation-and-engagement-in-the-workplace/ Agile training is most effective when participants actively experiment with new tools and techniques in their own work environments, adapting them to fit their team’s context. Techniques like “One, Two, Four, All” foster inclusive engagement and help turn group ideas into actionable plans, even in virtual settings. Development managers should encourage their teams to try these approaches and create safe spaces for sharing, which leads to better collaboration and practical results. https://engineering-leadership.hinshelwood.com/videos/if-you-could-teach-just-one-thing-about-scrum-what-would-it-be/ Mon, 27 Feb 2023 07:00:01 +0000 https://engineering-leadership.hinshelwood.com/videos/if-you-could-teach-just-one-thing-about-scrum-what-would-it-be/ The most important thing to teach about Scrum is the principle of empiricism, which means making work transparent, inspecting progress frequently, and adapting based on what is learned. This approach helps teams navigate complex, uncertain environments where traditional project management falls short. Focus on building your team’s ability to learn and adapt quickly, as Scrum reveals problems but does not solve them for you. https://engineering-leadership.hinshelwood.com/videos/unlocking-unrealised-value-the-key-to-elevating-your-product-development-strategy/ Tue, 11 Feb 2025 06:00:40 +0000 https://engineering-leadership.hinshelwood.com/videos/unlocking-unrealised-value-the-key-to-elevating-your-product-development-strategy/ Unrealised value, or the features your users need but you have not built or identified yet, is often overlooked but crucial for product success. To unlock this value, focus on understanding your users, validate assumptions with small experiments before full development, and increase deployment frequency to speed up feedback and learning. Make it a priority to continuously learn from your market and adapt your product strategy to stay relevant and maximise impact. https://engineering-leadership.hinshelwood.com/guides/evidence-based-portfolio-management/ Wed, 16 Dec 2020 13:11:40 +0000 https://engineering-leadership.hinshelwood.com/guides/evidence-based-portfolio-management/ Explains how evidence-based portfolio management helps organisations extend agile practices beyond teams, enabling greater responsiveness and improved business outcomes. https://engineering-leadership.hinshelwood.com/videos/why-are-recessions-a-great-time-for-organizations-to-evaluate-the-opportunity-of-agile/ Thu, 09 Feb 2023 07:15:02 +0000 https://engineering-leadership.hinshelwood.com/videos/why-are-recessions-a-great-time-for-organizations-to-evaluate-the-opportunity-of-agile/ Recessions are an ideal time for organizations to consider agile because uncertainty highlights the need to adapt quickly, focus on customer value, and empower teams to make decisions. Agile enables rapid learning, continuous improvement, and faster response to market changes compared to traditional management. Development managers should pilot agile practices in small, iterative cycles to test their impact and build on what works. https://engineering-leadership.hinshelwood.com/articles/product-goal-is-an-intermediate-strategic-goal/ Mon, 21 Dec 2020 14:27:00 +0000 https://engineering-leadership.hinshelwood.com/articles/product-goal-is-an-intermediate-strategic-goal/ Product Goals serve as intermediate steps that help teams evaluate and adapt progress toward broader strategic objectives, especially in uncertain environments. Focusing on outcomes over outputs, investing in discovery through flexible team allocation, and running hypothesis-driven experiments are key to delivering real value. Development managers should shift away from traditional project management and factory-style practices, adopting a data-driven, experimental approach to stay competitive and responsive. https://engineering-leadership.hinshelwood.com/videos/mastering-assumptions-unlocking-success-in-product-development-through-hypothesis-driven-strategies/ Tue, 20 Aug 2024 07:06:21 +0000 https://engineering-leadership.hinshelwood.com/videos/mastering-assumptions-unlocking-success-in-product-development-through-hypothesis-driven-strategies/ Success in product development depends on identifying, prioritising, and validating assumptions through structured hypotheses and targeted experiments. Focusing on the most critical assumptions, using data-driven testing, and avoiding attachment to unproven ideas leads to better decision-making and outcomes. Development managers should foster a culture of learning and adaptability by encouraging teams to challenge assumptions and iterate based on evidence. https://engineering-leadership.hinshelwood.com/videos/unlocking-effective-product-development-how-a-hypothesis-driven-approach-transforms-user-experience/ Mon, 10 Apr 2023 07:00:18 +0000 https://engineering-leadership.hinshelwood.com/videos/unlocking-effective-product-development-how-a-hypothesis-driven-approach-transforms-user-experience/ A hypothesis-driven approach to product development helps teams make better decisions by focusing on user needs, testing ideas with small experiments, and measuring outcomes before committing to full features. Collaboration between design and engineering is essential to align daily decisions with long-term goals, and integrating these practices into continuous delivery ensures ongoing improvement. Development managers should encourage experimentation, cross-team collaboration, and data-driven feedback loops to build products that truly meet user needs. https://engineering-leadership.hinshelwood.com/videos/mastering-product-development-from-assumptions-to-hypotheses/ Sat, 10 Aug 2024 07:00:32 +0000 https://engineering-leadership.hinshelwood.com/videos/mastering-product-development-from-assumptions-to-hypotheses/ This course teaches development managers how to identify, prioritize, and validate assumptions in product development by turning them into testable hypotheses, focusing on data-driven decision-making rather than gut feelings. Key insights include learning to distinguish critical assumptions from trivial ones, balancing the cost and confidence of experiments, and using experiment results to guide strategy. The main takeaway is to adopt a mindset that values learning and evidence, leading to more effective and efficient product development. https://engineering-leadership.hinshelwood.com/tags/experimentation/ Tue, 11 Feb 2025 10:17:24 +0000 https://engineering-leadership.hinshelwood.com/tags/experimentation/ Experimentation is a fundamental practice within agile workflows that utilises hypothesis-driven methods to test ideas and validate assumptions. Originating from the need to systematically address uncertainties, this approach enables teams to make informed decisions based on empirical evidence rather than relying solely on intuition. The importance of experimentation is underscored by its ability to facilitate predictable and sustainable value delivery, fostering a culture where failure is perceived as a learning opportunity that drives continuous improvement and resilience. Through iterative testing and feedback loops, teams can refine their products and processes, ensuring they align with customer needs and organisational objectives. Furthermore, experimentation promotes long-term systemic change by integrating a scientific mindset into the organisational culture, enhancing collaboration among cross-functional teams and boosting engagement as team members witness the direct impact of their efforts. By prioritising experimentation, organisations can create an environment that values learning and adaptability, which is essential for effective and innovative product development in today’s complex and rapidly changing landscape. This practice serves not just as a tactic but as a foundational element that influences how teams operate and evolve. https://engineering-leadership.hinshelwood.com/tags/hypothesis-driven-development/ Tue, 11 Feb 2025 10:17:24 +0000 https://engineering-leadership.hinshelwood.com/tags/hypothesis-driven-development/ Hypothesis Driven Development is a structured methodology that utilises experimentation and validated learning to guide product decisions. Originating from the need to make informed choices based on user needs and behaviours, this approach enables teams to formulate hypotheses and design experiments that test these assumptions in real-world contexts. Its importance lies in enhancing predictability and sustainability in delivering value, as it allows organisations to gather actionable data and insights that inform product development, thereby reducing reliance on intuition. By continuously testing and iterating on ideas, teams can swiftly adapt to evolving market conditions and user feedback, minimising the risk of developing products that fail to meet customer expectations. This methodology fosters a culture of learning and experimentation, encouraging teams to embrace uncertainty and view setbacks as opportunities for growth. In contrast to traditional development methods that often depend on extensive upfront planning, Hypothesis Driven Development promotes an agile mindset where learning and adaptation are central to the process. This long-term, systemic approach not only leads to improved product outcomes but also empowers teams to innovate and effectively tackle emerging challenges, ultimately contributing to organisational success through a more profound understanding of customer value and market dynamics. https://engineering-leadership.hinshelwood.com/tags/lean-product-development/ Tue, 11 Feb 2025 10:17:24 +0000 https://engineering-leadership.hinshelwood.com/tags/lean-product-development/ Lean Product Development is a methodology that centres on minimising waste and maximising learning throughout the product creation process, drawing from Lean principles that prioritise efficiency and value delivery by eliminating non-value-adding activities. This approach is utilised to foster a culture of continuous improvement, enabling teams to swiftly adapt to changing market demands and customer feedback, thereby ensuring the development of relevant and high-quality products. By empowering cross-functional teams to collaborate effectively and employing tools like Kanban to visualise workflows and identify bottlenecks, Lean Product Development promotes iterative cycles of experimentation that allow for the validation of assumptions and necessary pivots. This is particularly vital in today’s fast-paced environment, where responsiveness is key. The focus on systemic thinking aligns all aspects of product development with organisational goals, encouraging a sustainable approach to innovation. By integrating Lean practices, organisations can enhance their capacity to deliver value predictably, cultivating a culture that values learning and adaptability over rigid processes. This long-term emphasis on efficiency and responsiveness equips teams to excel in a competitive landscape, ultimately leading to improved outcomes for both the organisation and its customers. https://engineering-leadership.hinshelwood.com/tags/lean-startup/ Tue, 11 Feb 2025 10:17:24 +0000 https://engineering-leadership.hinshelwood.com/tags/lean-startup/ Lean Startup is a methodology that integrates Lean principles into the development of new business ideas, prioritising rapid experimentation and validated learning. Originating from the need to minimise risk and investment in product development, it advocates for the creation of a minimum viable product (MVP) to test assumptions about customer needs and market viability. This approach allows teams to collect real-time feedback, facilitating informed decisions to pivot or persevere based on empirical evidence rather than mere speculation. By cultivating a culture of experimentation, Lean Startup enables organisations to innovate continuously and adapt quickly to shifting market dynamics. It promotes cross-functional collaboration, ensuring that insights from diverse stakeholders shape product development. While it shares similarities with Agile methodologies, Lean Startup uniquely emphasises the validation of business models and market fit, thereby supporting long-term sustainability. This systemic approach embeds learning within the organisation, fostering resilience and adaptability in a constantly changing environment. Ultimately, Lean Startup enhances the likelihood of delivering products that meet genuine customer demands, optimising resource allocation and aligning organisational goals with customer needs. https://engineering-leadership.hinshelwood.com/tags/minimum-viable-product/ Tue, 11 Feb 2025 10:17:24 +0000 https://engineering-leadership.hinshelwood.com/tags/minimum-viable-product/ Minimum Viable Product (MVP) is a fundamental concept in product development that emphasises the creation of a product version with just enough features to meet the needs of early adopters and facilitate feedback for subsequent iterations. Originating from lean startup methodologies, the MVP approach enables teams to quickly test hypotheses and validate market assumptions, thereby minimising the risk associated with investing substantial resources in untested ideas. This strategy not only accelerates product launches but also fosters a culture of experimentation and learning, which is essential for organisations seeking sustainable innovation. By promoting cross-functional collaboration, teams can collectively determine the essential features of the product, enhancing its relevance and aligning team members around common objectives. The MVP framework is not solely focused on speed; it establishes a basis for continuous improvement and value delivery, allowing organisations to remain responsive to evolving market conditions and customer preferences. Ultimately, this approach supports long-term success and resilience in a competitive environment by ensuring that products are developed in a manner that maximises value over time. https://engineering-leadership.hinshelwood.com/tags/product-validation/ Tue, 11 Feb 2025 10:17:24 +0000 https://engineering-leadership.hinshelwood.com/tags/product-validation/ Product validation is the process of testing product ideas with actual users to confirm that they meet market demands and provide real customer value. This practice is essential for organisations seeking to develop products that connect with their target audience, as it reduces the risk of investing in features or solutions that do not meet user expectations. By involving users early and frequently, teams can collect feedback that informs design and functionality, facilitating iterative enhancements that improve product-market fit. The importance of product validation lies in its capacity to enable teams to deliver value in a predictable and sustainable manner, fostering a culture of experimentation and learning where assumptions are validated through real-world data rather than theoretical models. This not only speeds up the development process but also increases the likelihood of product success in a competitive environment. Additionally, product validation is a long-term, systemic practice that aligns well with agile methodologies, lean principles, and DevOps practices. It promotes cross-functional collaboration and empowers teams to make informed decisions based on user insights, ultimately driving continuous improvement and innovation. By prioritising validation, organisations can establish a strong feedback loop that enhances their adaptability and resilience in a constantly changing market.