Download or read book Experimentation Works written by Stefan H. Thomke and published by Harvard Business Press. This book was released on 2020-02-18 with total page 252 pages. Available in PDF, EPUB and Kindle. Book excerpt: Don't fly blind. See how the power of experiments works for you. When it comes to improving customer experiences, trying out new business models, or developing new products, even the most experienced managers often get it wrong. They discover that intuition, experience, and big data alone don't work. What does? Running disciplined business experiments. And what if companies roll out new products or introduce new customer experiences without running these experiments? They fly blind. That's what Harvard Business School professor Stefan Thomke shows in this rigorously researched and eye-opening book. It guides you through best practices in business experimentation, illustrates how these practices work at leading companies, and answers some fundamental questions: What makes a good experiment? How do you test in online and brick-and-mortar businesses? In B2B and B2C? How do you build an experimentation culture? Also, best practice means running many experiments. Indeed, some hugely successful companies, such as Amazon, Booking.com, and Microsoft, run tens of thousands of controlled experiments annually, engaging millions of users. Thomke shows us how these and many other organizations prove that experimentation provides significant competitive advantage. How can managers create this capability at their own companies? Essential is developing an experimentation organization that prizes the science of testing and puts the discipline of experimentation at the center of its innovation process. While it once took companies years to develop the tools for such large-scale experiments, advances in technology have put these tools at the fingertips of almost any business professional. By combining the power of software and the rigor of controlled experiments, today's managers can make better decisions, create magical customer experiences, and generate big financial returns. Experimentation Works is your guidebook to a truly new way of thinking and innovating.

Download or read book Business Experimentation written by Rob James and published by Kogan Page Publishers. This book was released on 2021-09-03 with total page 273 pages. Available in PDF, EPUB and Kindle. Book excerpt: Business experimentation can not only create measurable value for organizations, it can provide the inspiration to break with the habits of the past by dealing with challenges and exploiting opportunities. This book is a step-by-step, practical guide to the six-stage business experiment process, from understanding the problem or opportunity to creating a hypothesis, planning the experiment and analysing the findings. It explores the top design criteria for successful and impactful business experiments and includes valuable case studies covering problem solving, performance improvement and strategic innovation. To support the process, Business Experimentation also includes downloadable, editable templates, worksheets and activities for use in ideation and planning sessions. This business experiment methodology can be used to support a one-off initiative or to underpin desired behaviours as part of a wider organizational change programme, as experimentation encourages people to be bold, take risks and seek new ways of doing things. Based on programmes the authors have run with a variety of leading organizations and with astonishing results, this practical guide provides businesses with the confidence to get started with experimentation and the tools to succeed.

Download or read book Testing Business Ideas written by David J. Bland and published by John Wiley & Sons. This book was released on 2019-11-06 with total page 369 pages. Available in PDF, EPUB and Kindle. Book excerpt: A practical guide to effective business model testing 7 out of 10 new products fail to deliver on expectations. Testing Business Ideas aims to reverse that statistic. In the tradition of Alex Osterwalder’s global bestseller Business Model Generation, this practical guide contains a library of hands-on techniques for rapidly testing new business ideas. Testing Business Ideas explains how systematically testing business ideas dramatically reduces the risk and increases the likelihood of success for any new venture or business project. It builds on the internationally popular Business Model Canvas and Value Proposition Canvas by integrating Assumptions Mapping and other powerful lean startup-style experiments. Testing Business Ideas uses an engaging 4-color format to: Increase the success of any venture and decrease the risk of wasting time, money, and resources on bad ideas Close the knowledge gap between strategy and experimentation/validation Identify and test your key business assumptions with the Business Model Canvas and Value Proposition Canvas A definitive field guide to business model testing, this book features practical tips for making major decisions that are not based on intuition and guesses. Testing Business Ideas shows leaders how to encourage an experimentation mindset within their organization and make experimentation a continuous, repeatable process.

Download or read book Experimentation Matters written by Stefan H. Thomke and published by Harvard Business Press. This book was released on 2003 with total page 336 pages. Available in PDF, EPUB and Kindle. Book excerpt: Every company's ability to innovate depends on a process of experimentation whereby new products and services are created and existing ones improved. But the cost of experimentation often limits innovation. New technologies--including computer modeling and simulation--promise to lift that constraint by changing the economics of experimentation. Never before has it been so economically feasible to ask "what-if" questions and generate preliminary answers. These technologies amplify the impact of learning, paving the way for higher R&D performance and innovation and new ways of creating value for customers.In Experimentation Matters, Stefan Thomke argues that to unlock such potential, companies must not only understand the power of experimentation and new technologies, but also change their processes, organization, and management of innovation. He explains why experimentation is so critical to innovation, underscores the impact of new technologies, and outlines what managers must do to integrate them successfully. Drawing on a decade of research in multiple industries as diverse as automotive, semiconductors, pharmaceuticals, chemicals, and banking, Thomke provides striking illustrations of how companies drive strategy and value creation by accommodating their organizations to new experimentation technologies.As in the outcome of any effective experiment, Thomke also reveals where that has not happened, and explains why. In particular, he shows managers how to: implement "front-loaded" innovation processes that identify potential problems before resources are committed and design decisions locked in; experiment and test frequently without overloading their organizations; integrate new technologies into the current innovation system; organize for rapid experimentation; fail early and often, but avoid wasteful "mistakes"; and manage projects as experiments.Pointing to the custom integrated circuit industry--a multibillion dollar market--Thomke also shows what happens when new experimentation technologies are taken beyond firm boundaries, thereby changing the way companies create new products and services with customers and suppliers. Probing and thoughtful, Experimentation Matters will influence how both executives and academics think about experimentation in general and innovation processes in particular. Experimentation has always been the engine of innovation, and Thomke reveals how it works today.

Download or read book The Power of Experiments written by Michael Luca and published by MIT Press. This book was released on 2021-03-02 with total page 229 pages. Available in PDF, EPUB and Kindle. Book excerpt: How tech companies like Google, Airbnb, StubHub, and Facebook learn from experiments in our data-driven world—an excellent primer on experimental and behavioral economics Have you logged into Facebook recently? Searched for something on Google? Chosen a movie on Netflix? If so, you've probably been an unwitting participant in a variety of experiments—also known as randomized controlled trials—designed to test the impact of different online experiences. Once an esoteric tool for academic research, the randomized controlled trial has gone mainstream. No tech company worth its salt (or its share price) would dare make major changes to its platform without first running experiments to understand how they would influence user behavior. In this book, Michael Luca and Max Bazerman explain the importance of experiments for decision making in a data-driven world. Luca and Bazerman describe the central role experiments play in the tech sector, drawing lessons and best practices from the experiences of such companies as StubHub, Alibaba, and Uber. Successful experiments can save companies money—eBay, for example, discovered how to cut $50 million from its yearly advertising budget—or bring to light something previously ignored, as when Airbnb was forced to confront rampant discrimination by its hosts. Moving beyond tech, Luca and Bazerman consider experimenting for the social good—different ways that governments are using experiments to influence or “nudge” behavior ranging from voter apathy to school absenteeism. Experiments, they argue, are part of any leader's toolkit. With this book, readers can become part of “the experimental revolution.”

Download or read book Experimentation in Software Engineering written by Claes Wohlin and published by Springer Science & Business Media. This book was released on 2012-06-16 with total page 249 pages. Available in PDF, EPUB and Kindle. Book excerpt: Like other sciences and engineering disciplines, software engineering requires a cycle of model building, experimentation, and learning. Experiments are valuable tools for all software engineers who are involved in evaluating and choosing between different methods, techniques, languages and tools. The purpose of Experimentation in Software Engineering is to introduce students, teachers, researchers, and practitioners to empirical studies in software engineering, using controlled experiments. The introduction to experimentation is provided through a process perspective, and the focus is on the steps that we have to go through to perform an experiment. The book is divided into three parts. The first part provides a background of theories and methods used in experimentation. Part II then devotes one chapter to each of the five experiment steps: scoping, planning, execution, analysis, and result presentation. Part III completes the presentation with two examples. Assignments and statistical material are provided in appendixes. Overall the book provides indispensable information regarding empirical studies in particular for experiments, but also for case studies, systematic literature reviews, and surveys. It is a revision of the authors’ book, which was published in 2000. In addition, substantial new material, e.g. concerning systematic literature reviews and case study research, is introduced. The book is self-contained and it is suitable as a course book in undergraduate or graduate studies where the need for empirical studies in software engineering is stressed. Exercises and assignments are included to combine the more theoretical material with practical aspects. Researchers will also benefit from the book, learning more about how to conduct empirical studies, and likewise practitioners may use it as a “cookbook” when evaluating new methods or techniques before implementing them in their organization.

Download or read book Connected Business written by Oliver Gassmann and published by Springer Nature. This book was released on 2021-08-11 with total page 415 pages. Available in PDF, EPUB and Kindle. Book excerpt: How do you develop business in a world certain to be dominated by Internet of Things, Artificial Intelligence, and the Economy of Things?This book brings together leading scholars from academia, established practitioners, and thought-leading consultants who analyse and provide guidance to answer this question. Case studies, checklists, success factors, help readers get a grip on this fast-paced development. At the same time, the authors do not shy away from addressing the hurdles and barriers to implementation. This book provides an essential food-for-thought for leaders and managers, both visionary and pragmatic, who are faced with the responsibility of steering their business through these challenging, yet exciting, times.

Download or read book Basics of Software Engineering Experimentation written by Natalia Juristo and published by Springer Science & Business Media. This book was released on 2013-03-14 with total page 405 pages. Available in PDF, EPUB and Kindle. Book excerpt: Basics of Software Engineering Experimentation is a practical guide to experimentation in a field which has long been underpinned by suppositions, assumptions, speculations and beliefs. It demonstrates to software engineers how Experimental Design and Analysis can be used to validate their beliefs and ideas. The book does not assume its readers have an in-depth knowledge of mathematics, specifying the conceptual essence of the techniques to use in the design and analysis of experiments and keeping the mathematical calculations clear and simple. Basics of Software Engineering Experimentation is practically oriented and is specially written for software engineers, all the examples being based on real and fictitious software engineering experiments.

Download or read book Trustworthy Online Controlled Experiments written by Ron Kohavi and published by Cambridge University Press. This book was released on 2020-04-02 with total page 291 pages. Available in PDF, EPUB and Kindle. Book excerpt: Getting numbers is easy; getting numbers you can trust is hard. This practical guide by experimentation leaders at Google, LinkedIn, and Microsoft will teach you how to accelerate innovation using trustworthy online controlled experiments, or A/B tests. Based on practical experiences at companies that each run more than 20,000 controlled experiments a year, the authors share examples, pitfalls, and advice for students and industry professionals getting started with experiments, plus deeper dives into advanced topics for practitioners who want to improve the way they make data-driven decisions. Learn how to • Use the scientific method to evaluate hypotheses using controlled experiments • Define key metrics and ideally an Overall Evaluation Criterion • Test for trustworthiness of the results and alert experimenters to violated assumptions • Build a scalable platform that lowers the marginal cost of experiments close to zero • Avoid pitfalls like carryover effects and Twyman's law • Understand how statistical issues play out in practice.

Download or read book Experiment Driven Product Development written by Paul Rissen and published by Apress. This book was released on 2019-11-21 with total page 133 pages. Available in PDF, EPUB and Kindle. Book excerpt: Improving your craft is a key skill for product and user experience professionals working in the digital era. There are many established methods of product development to inspire and focus teams—Sprint, Lean, Agile, Kanban—all of which focus on solutions to customer and business problems. Enter XDPD, or Experiment-Driven Product Development—a new approach that turns the spotlight on questions to be answered, rather than on solutions. Within XDPD, discovery is a mindset, not a project phase. In Experiment-Driven Product Development, author Paul Rissen introduces a philosophy of product development that will hone your skills in discovery, research and learning. By guiding you through a practical, immediately applicable framework, you can learn to ask, and answer, questions which will supercharge your product development, making teams smarter and better at developing products and services that deliver for users and businesses alike. When applying the XDPD framework within your organization, the concept of an experiment—a structured way of asking, and answering, questions—becomes the foundation of almost everything you do, instilling a constant sense of discovery that keeps your team inspired. All types of activities, from data analysis to writing software, are seen through the lens of research. Rather than treating research as a separate task from the rest of product development, this book approaches the entire practice as one of research and continuous discovery. Designing successful experiments takes practice. That’s where Rissen’s years of industry expertise come in. In this book, you are given step-by-step tools to ensure that meaningful, efficient progress is made with each experiment. This approach will prove beneficial to your team, your users, and most importantly, to your product’s lasting success. Experiment-Driven Product Development offers a greater appreciation of the craft of experimentation and helps you adapt it in your own context. In our modern age of innovation, XDPD can put you ahead. Go forth and experiment! What You Will LearnKnow how to approach product development in a leaner, more efficient wayUnderstand where and when experiments can be useful, and how they fit into pre-existing organization environments and processesRealize why you should be thinking about the simplest, useful thing rather than the minimum, viable productDiscover how to break down feature and design ideas into the assumptions and the premises that lie behind themAppreciate the importance of designing your experiments, and the statistical concepts that underpin their successMaster the art of communicating the results of experiments back to stakeholders, and help the results guide what happens next Who This Book is For Professionals working in digital product design and development, user experience, and service design. This book is best suited for those who work on digital products every day and want to adopt better approaches to gaining knowledge about their users, what works, and what does not work.

Download or read book Business Experiments with R written by B. D. McCullough and published by John Wiley & Sons. This book was released on 2021-02-24 with total page 384 pages. Available in PDF, EPUB and Kindle. Book excerpt: BUSINESS EXPERIMENTS with R A unique text that simplifies experimental business design and is dedicated to the R language Business Experiments with R offers a guide to, and explores the fundamentals of experimental business designs. The book fills a gap in the literature to provide a text on the topic of business statistics that addresses issues such as small samples, lack of normality, and data confounding. The author—a noted expert on the topic—puts the focus on the A/B tests (and their variants) that are widely used in industry, but not typically covered in business statistics textbooks. The text contains the tools needed to design and analyze two-treatment experiments (i.e., A/B tests) to answer business questions. The author highlights the strategic and technical issues involved in designing experiments that will truly affect organizations. The book then builds on the foundation in Part I and expands the multivariable testing. Since today’s companies are using experiments to solve a broad range of problems, Business Experiments with R is an essential resource for any business student. This important text: Presents the key ideas that business students need to know about experiments Offers a series of examples, focusing on a specific business question Helps develop the ability to frame ill-defined problems and determine what data and analysis would provide information about that problem Written for students of general business, marketing, and business analytics, Business Experiments with R is an important text that helps to answer business questions by highlighting the strategic and technical issues involved in designing experiments that will truly affect organizations.

Download or read book Screening written by Angela Dean and published by Springer Science & Business Media. This book was released on 2006-07-28 with total page 347 pages. Available in PDF, EPUB and Kindle. Book excerpt: The process of discovery in science and technology may require investigation of a large number of features, such as factors, genes or molecules. In Screening, statistically designed experiments and analyses of the resulting data sets are used to identify efficiently the few features that determine key properties of the system under study. This book brings together accounts by leading international experts that are essential reading for those working in fields such as industrial quality improvement, engineering research and development, genetic and medical screening, drug discovery, and computer simulation of manufacturing systems or economic models. Our aim is to promote cross-fertilization of ideas and methods through detailed explanations, a variety of examples and extensive references. Topics cover both physical and computer simulated experiments. They include screening methods for detecting factors that affect the value of a response or its variability, and for choosing between various different response models. Screening for disease in blood samples, for genes linked to a disease and for new compounds in the search for effective drugs are also described. Statistical techniques include Bayesian and frequentist methods of data analysis, algorithmic methods for both the design and analysis of experiments, and the construction of fractional factorial designs and orthogonal arrays. The material is accessible to graduate and research statisticians, and to engineers and chemists with a working knowledge of statistical ideas and techniques. It will be of interest to practitioners and researchers who wish to learn about useful methodologies from within their own area as well as methodologies that can be translated from one area to another.

Download or read book The Innovator s Hypothesis written by Michael Schrage and published by MIT Press. This book was released on 2014-09-12 with total page 254 pages. Available in PDF, EPUB and Kindle. Book excerpt: What is the best way for a company to innovate? That's exactly the wrong question.The better question: How can organizations get the maximum possible value from their innovationinvestments? Advice recommending "innovation vacations" and the luxury of failure may bewonderful for organizations with time to spend and money to waste. But this book addresses theinnovation priorities of companies that live in the real world of limits. They want fast, frugal,and high impact innovations. They don't just seek superior innovation, they want superiorinnovators. In The Innovator's Hypothesis, innovation expertMichael Schrage advocates a cultural and strategic shift: small teams, collaboratively--andcompetitively -- crafting business experiments that make top management sit up and take notice.Creativity within constraints -- clear deadlines and clear deliverables -- is what seriousinnovation cultures do. Schrage introduces the 5X5 framework: giving diverse teams of five people upto five days to come up with portfolios of five business experiments costing no more than $5,000each and taking no longer than five weeks to run. The book describes multiple portfolios of 5X5experiments drawn from Schrage's advisory work and innovation workshops worldwide. These includefinancial service approaches for improving customer service and addressing security challenges; apharmaceutical company's hypotheses for boosting regulatory compliance; and a diaper divisions'efforts to give babies and parents alike better "diapering experiences" withglow-in-the-dark adhesives, diagnostic capability, and bundled wipes. Schrage's5X5 is enterprise innovation gone viral: Successful 5X5s make people more effective innovators, andmore effective innovators mean more effective innovations.

Download or read book Experimentation for Engineers written by David Sweet and published by Simon and Schuster. This book was released on 2023-03-21 with total page 246 pages. Available in PDF, EPUB and Kindle. Book excerpt: Optimize the performance of your systems with practical experiments used by engineers in the world’s most competitive industries. In Experimentation for Engineers: From A/B testing to Bayesian optimization you will learn how to: Design, run, and analyze an A/B test Break the "feedback loops" caused by periodic retraining of ML models Increase experimentation rate with multi-armed bandits Tune multiple parameters experimentally with Bayesian optimization Clearly define business metrics used for decision-making Identify and avoid the common pitfalls of experimentation Experimentation for Engineers: From A/B testing to Bayesian optimization is a toolbox of techniques for evaluating new features and fine-tuning parameters. You’ll start with a deep dive into methods like A/B testing, and then graduate to advanced techniques used to measure performance in industries such as finance and social media. Learn how to evaluate the changes you make to your system and ensure that your testing doesn’t undermine revenue or other business metrics. By the time you’re done, you’ll be able to seamlessly deploy experiments in production while avoiding common pitfalls. About the technology Does my software really work? Did my changes make things better or worse? Should I trade features for performance? Experimentation is the only way to answer questions like these. This unique book reveals sophisticated experimentation practices developed and proven in the world’s most competitive industries that will help you enhance machine learning systems, software applications, and quantitative trading solutions. About the book Experimentation for Engineers: From A/B testing to Bayesian optimization delivers a toolbox of processes for optimizing software systems. You’ll start by learning the limits of A/B testing, and then graduate to advanced experimentation strategies that take advantage of machine learning and probabilistic methods. The skills you’ll master in this practical guide will help you minimize the costs of experimentation and quickly reveal which approaches and features deliver the best business results. What's inside Design, run, and analyze an A/B test Break the “feedback loops” caused by periodic retraining of ML models Increase experimentation rate with multi-armed bandits Tune multiple parameters experimentally with Bayesian optimization About the reader For ML and software engineers looking to extract the most value from their systems. Examples in Python and NumPy. About the author David Sweet has worked as a quantitative trader at GETCO and a machine learning engineer at Instagram. He teaches in the AI and Data Science master's programs at Yeshiva University. Table of Contents 1 Optimizing systems by experiment 2 A/B testing: Evaluating a modification to your system 3 Multi-armed bandits: Maximizing business metrics while experimenting 4 Response surface methodology: Optimizing continuous parameters 5 Contextual bandits: Making targeted decisions 6 Bayesian optimization: Automating experimental optimization 7 Managing business metrics 8 Practical considerations

Download or read book The Innovator s DNA written by Jeff Dyer and published by Harvard Business Press. This book was released on 2011-07-12 with total page 272 pages. Available in PDF, EPUB and Kindle. Book excerpt: A new classic, cited by leaders and media around the globe as a highly recommended read for anyone interested in innovation. In The Innovator’s DNA, authors Jeffrey Dyer, Hal Gregersen, and bestselling author Clayton Christensen (The Innovator’s Dilemma, The Innovator’s Solution, How Will You Measure Your Life?) build on what we know about disruptive innovation to show how individuals can develop the skills necessary to move progressively from idea to impact. By identifying behaviors of the world’s best innovators—from leaders at Amazon and Apple to those at Google, Skype, and Virgin Group—the authors outline five discovery skills that distinguish innovative entrepreneurs and executives from ordinary managers: Associating, Questioning, Observing, Networking, and Experimenting. Once you master these competencies (the authors provide a self-assessment for rating your own innovator’s DNA), the authors explain how to generate ideas, collaborate to implement them, and build innovation skills throughout the organization to result in a competitive edge. This innovation advantage will translate into a premium in your company’s stock price—an innovation premium—which is possible only by building the code for innovation right into your organization’s people, processes, and guiding philosophies. Practical and provocative, The Innovator’s DNA is an essential resource for individuals and teams who want to strengthen their innovative prowess.

Download or read book Business Model Generation written by Alexander Osterwalder and published by John Wiley & Sons. This book was released on 2013-02-01 with total page 295 pages. Available in PDF, EPUB and Kindle. Book excerpt: Business Model Generation is a handbook for visionaries, game changers, and challengers striving to defy outmoded business models and design tomorrow's enterprises. If your organization needs to adapt to harsh new realities, but you don't yet have a strategy that will get you out in front of your competitors, you need Business Model Generation. Co-created by 470 "Business Model Canvas" practitioners from 45 countries, the book features a beautiful, highly visual, 4-color design that takes powerful strategic ideas and tools, and makes them easy to implement in your organization. It explains the most common Business Model patterns, based on concepts from leading business thinkers, and helps you reinterpret them for your own context. You will learn how to systematically understand, design, and implement a game-changing business model--or analyze and renovate an old one. Along the way, you'll understand at a much deeper level your customers, distribution channels, partners, revenue streams, costs, and your core value proposition. Business Model Generation features practical innovation techniques used today by leading consultants and companies worldwide, including 3M, Ericsson, Capgemini, Deloitte, and others. Designed for doers, it is for those ready to abandon outmoded thinking and embrace new models of value creation: for executives, consultants, entrepreneurs, and leaders of all organizations. If you're ready to change the rules, you belong to "the business model generation!"

Download or read book The American Experiment written by David M. Rubenstein and published by Simon and Schuster. This book was released on 2021-09-07 with total page 464 pages. Available in PDF, EPUB and Kindle. Book excerpt: THE INSTANT NEW YORK TIMES AND WALL STREET JOURNAL BESTSELLER The capstone book in a trilogy from the New York Times bestselling author of How to Lead and The American Story and host of Bloomberg TV’s The David Rubenstein Show—American icons and historians on the ever-evolving American experiment, featuring Ken Burns, Madeleine Albright, Wynton Marsalis, Billie Jean King, Henry Louis Gates Jr., and many more. In this lively collection of conversations—the third in a series from David Rubenstein—some of our nations’ greatest minds explore the inspiring story of America as a grand experiment in democracy, culture, innovation, and ideas. -Jill Lepore on the promise of America -Madeleine Albright on the American immigrant -Ken Burns on war -Henry Louis Gates Jr. on reconstruction -Elaine Weiss on suffrage -John Meacham on civil rights -Walter Isaacson on innovation -David McCullough on the Wright Brothers -John Barry on pandemics and public health -Wynton Marsalis on music -Billie Jean King on sports -Rita Moreno on film Exploring the diverse make-up of our country’s DNA through interviews with Pulitzer Prize–winning historians, diplomats, music legends, and sports giants, The American Experiment captures the dynamic arc of a young country reinventing itself in real-time. Through these enlightening conversations, the American spirit comes alive, revealing the setbacks, suffering, invention, ingenuity, and social movements that continue to shape our vision of what America is—and what it can be.