{"id":1922,"date":"2021-11-11T13:28:12","date_gmt":"2021-11-11T18:28:12","guid":{"rendered":"http:\/\/digital.hec.ca\/en\/?p=1922"},"modified":"2023-03-26T11:55:39","modified_gmt":"2023-03-26T15:55:39","slug":"common-a-b-testing-mistakes","status":"publish","type":"post","link":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/","title":{"rendered":"Common A\/B testing mistakes"},"content":{"rendered":"

When it\u2019s time to improve a user\u2019s digital experience, many things can be done. Among these things, one can do what is known as A\/B testing. In the following article I will explain what is A\/B testing exactly and what are the frequent A\/B testing mistakes.<\/p>\n

What is A\/B testing?<\/strong><\/h3>\n

First, A\/B testing is a way of comparing the performance of different web pages between them. For each page or content, two versions will be created: version A and version B. There will be only one thing different on each version. For example, the Contact us<\/em> button will be red on page A and blue in page B. Users will then land on either version A or version B. Success of a version is determined by the purpose of the website. For instance, a foundation will track how many people actually click on the button to donate.<\/p>\n

\"\"<\/p>\n

A\/B mistakes<\/strong><\/h3>\n

Nobody wants to waste time working on an experiment that turns out full of weaknesses. So, let\u2019s dive in and learn more about 3 common A\/B testing mistakes!<\/p>\n

Testing more than one aspect<\/strong><\/em><\/h4>\n

Testing more than one element at the same time is a big mistake! By doing so, it becomes impossible to pinpoint exactly what change worked. Is it the red color or the fact that the button is now at the top of the page? Hard to tell\u2026 Moreover, A\/B testing is designed to test simple elements such as new headlines, new images, new layout, new pricing, etc. Testing one change at a time is simple and avoids you a classic A\/B testing mistake.<\/p>\n

Not letting enough time<\/strong><\/em><\/h4>\n

With this kind of test, it is really important to let it run for at least a couple of weeks. Ideally, to steer clear of this A\/B testing mistake, the experience should last between 2 to 4 weeks. Less than that, the results won’t be accurate. In fact, in early beginnings, results tend to show high variability and small traffic volume. In short, let the experience run long enough and you can easily skip this A\/B testing mistake!<\/p>\n

Unrepresentative traffic volume<\/h4>\n

Another big A\/B testing mistake is having unrepresentative traffic. In other words, this means either having unequal traffic volume directed to the different versions of the web pages or content or having a traffic that is not determined randomly. This would be particularly hurtful as it is randomness that allows us to say we have a cause-effect relation.<\/p>\n

In brief, A\/B testing is a perfect way to test one element at a time. It is easy, cheap and simple to implement. However, in order to have accurate results, it needs to be done in a certain way to avoid mistakes.<\/p>\n

Sources:<\/strong><\/p>\n

https:\/\/www.convert.com\/blog\/a-b-testing\/ab-testing-mistakes\/<\/p>\n

Digital marketing Powerpoint, Theme 1<\/p>\n","protected":false},"excerpt":{"rendered":"

When it\u2019s time to improve a user\u2019s digital experience, many things can be done. Among these things, one can do what is known as A\/B testing. In the following article I will explain what is A\/B testing exactly and what are the frequent A\/B testing mistakes. What is A\/B testing? First, A\/B testing is a […]<\/p>\n","protected":false},"author":692,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[55],"tags":[],"class_list":["post-1922","post","type-post","status-publish","format-standard","hentry","category-user-experience"],"acf":[],"yoast_head":"\nCommon A\/B testing mistakes<\/title>\n<meta name=\"description\" content=\"A\/B testing is an excellent way to perform an analysis of content or a web page. However, some mistakes are easily avoidable!\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Common A\/B testing mistakes\" \/>\n<meta property=\"og:description\" content=\"A\/B testing is an excellent way to perform an analysis of content or a web page. However, some mistakes are easily avoidable!\" \/>\n<meta property=\"og:url\" content=\"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/\" \/>\n<meta property=\"og:site_name\" content=\"Marketing num\u00e9rique | Digital Marketing | HEC Montr\u00e9al\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/fr-ca.facebook.com\/HECMontreal\/\" \/>\n<meta property=\"article:published_time\" content=\"2021-11-11T18:28:12+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-03-26T15:55:39+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/digital.hec.ca\/en\/wp-content\/uploads\/sites\/2\/2021\/11\/ab-testing-1-300x157.png\" \/>\n<meta name=\"author\" content=\"allardfrederique\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"allardfrederique\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/common-a-b-testing-mistakes\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/common-a-b-testing-mistakes\\\/\"},\"author\":{\"name\":\"allardfrederique\",\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/#\\\/schema\\\/person\\\/6aa8b76b6d7d5f96d83fd782014ce6e5\"},\"headline\":\"Common A\\\/B testing mistakes\",\"datePublished\":\"2021-11-11T18:28:12+00:00\",\"dateModified\":\"2023-03-26T15:55:39+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/common-a-b-testing-mistakes\\\/\"},\"wordCount\":481,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/common-a-b-testing-mistakes\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2021\\\/11\\\/ab-testing-1-300x157.png\",\"articleSection\":[\"User Experience\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/common-a-b-testing-mistakes\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/common-a-b-testing-mistakes\\\/\",\"url\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/common-a-b-testing-mistakes\\\/\",\"name\":\"Common A\\\/B testing mistakes\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/common-a-b-testing-mistakes\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/common-a-b-testing-mistakes\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2021\\\/11\\\/ab-testing-1-300x157.png\",\"datePublished\":\"2021-11-11T18:28:12+00:00\",\"dateModified\":\"2023-03-26T15:55:39+00:00\",\"description\":\"A\\\/B testing is an excellent way to perform an analysis of content or a web page. However, some mistakes are easily avoidable!\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/common-a-b-testing-mistakes\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/common-a-b-testing-mistakes\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/common-a-b-testing-mistakes\\\/#primaryimage\",\"url\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2021\\\/11\\\/ab-testing-1-300x157.png\",\"contentUrl\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2021\\\/11\\\/ab-testing-1-300x157.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/common-a-b-testing-mistakes\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Common A\\\/B testing mistakes\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/\",\"name\":\"Marketing num\u00e9rique | Digital Marketing | HEC Montr\u00e9al\",\"description\":\"Fait par des \u00e9tudiants pour des \u00e9tudiants\",\"publisher\":{\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/#organization\",\"name\":\"HEC Montr\u00e9al\",\"url\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/digital.hec.ca\\\/wp-content\\\/uploads\\\/2025\\\/09\\\/Favicone.png\",\"contentUrl\":\"https:\\\/\\\/digital.hec.ca\\\/wp-content\\\/uploads\\\/2025\\\/09\\\/Favicone.png\",\"width\":512,\"height\":512,\"caption\":\"HEC Montr\u00e9al\"},\"image\":{\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/fr-ca.facebook.com\\\/HECMontreal\\\/\",\"https:\\\/\\\/www.youtube.com\\\/user\\\/HECMontreal\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/#\\\/schema\\\/person\\\/6aa8b76b6d7d5f96d83fd782014ce6e5\",\"name\":\"allardfrederique\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/8226eafd98ddffeee0d09356272a5e359bd4875220a4f65aae0a2e657dcf33bb?s=96&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/8226eafd98ddffeee0d09356272a5e359bd4875220a4f65aae0a2e657dcf33bb?s=96&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/8226eafd98ddffeee0d09356272a5e359bd4875220a4f65aae0a2e657dcf33bb?s=96&r=g\",\"caption\":\"allardfrederique\"},\"url\":\"https:\\\/\\\/digital.hec.ca\\\/en\\\/blog\\\/author\\\/allardfrederique\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Common A\/B testing mistakes","description":"A\/B testing is an excellent way to perform an analysis of content or a web page. However, some mistakes are easily avoidable!","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/","og_locale":"en_US","og_type":"article","og_title":"Common A\/B testing mistakes","og_description":"A\/B testing is an excellent way to perform an analysis of content or a web page. However, some mistakes are easily avoidable!","og_url":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/","og_site_name":"Marketing num\u00e9rique | Digital Marketing | HEC Montr\u00e9al","article_publisher":"https:\/\/fr-ca.facebook.com\/HECMontreal\/","article_published_time":"2021-11-11T18:28:12+00:00","article_modified_time":"2023-03-26T15:55:39+00:00","og_image":[{"url":"https:\/\/digital.hec.ca\/en\/wp-content\/uploads\/sites\/2\/2021\/11\/ab-testing-1-300x157.png","type":"","width":"","height":""}],"author":"allardfrederique","twitter_card":"summary_large_image","twitter_misc":{"Written by":"allardfrederique","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/#article","isPartOf":{"@id":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/"},"author":{"name":"allardfrederique","@id":"https:\/\/digital.hec.ca\/en\/#\/schema\/person\/6aa8b76b6d7d5f96d83fd782014ce6e5"},"headline":"Common A\/B testing mistakes","datePublished":"2021-11-11T18:28:12+00:00","dateModified":"2023-03-26T15:55:39+00:00","mainEntityOfPage":{"@id":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/"},"wordCount":481,"commentCount":0,"publisher":{"@id":"https:\/\/digital.hec.ca\/en\/#organization"},"image":{"@id":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/#primaryimage"},"thumbnailUrl":"https:\/\/digital.hec.ca\/en\/wp-content\/uploads\/sites\/2\/2021\/11\/ab-testing-1-300x157.png","articleSection":["User Experience"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/","url":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/","name":"Common A\/B testing mistakes","isPartOf":{"@id":"https:\/\/digital.hec.ca\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/#primaryimage"},"image":{"@id":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/#primaryimage"},"thumbnailUrl":"https:\/\/digital.hec.ca\/en\/wp-content\/uploads\/sites\/2\/2021\/11\/ab-testing-1-300x157.png","datePublished":"2021-11-11T18:28:12+00:00","dateModified":"2023-03-26T15:55:39+00:00","description":"A\/B testing is an excellent way to perform an analysis of content or a web page. However, some mistakes are easily avoidable!","breadcrumb":{"@id":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/#primaryimage","url":"https:\/\/digital.hec.ca\/en\/wp-content\/uploads\/sites\/2\/2021\/11\/ab-testing-1-300x157.png","contentUrl":"https:\/\/digital.hec.ca\/en\/wp-content\/uploads\/sites\/2\/2021\/11\/ab-testing-1-300x157.png"},{"@type":"BreadcrumbList","@id":"https:\/\/digital.hec.ca\/en\/blog\/common-a-b-testing-mistakes\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/digital.hec.ca\/en\/"},{"@type":"ListItem","position":2,"name":"Common A\/B testing mistakes"}]},{"@type":"WebSite","@id":"https:\/\/digital.hec.ca\/en\/#website","url":"https:\/\/digital.hec.ca\/en\/","name":"Marketing num\u00e9rique | Digital Marketing | HEC Montr\u00e9al","description":"Fait par des \u00e9tudiants pour des \u00e9tudiants","publisher":{"@id":"https:\/\/digital.hec.ca\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/digital.hec.ca\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/digital.hec.ca\/en\/#organization","name":"HEC Montr\u00e9al","url":"https:\/\/digital.hec.ca\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/digital.hec.ca\/en\/#\/schema\/logo\/image\/","url":"https:\/\/digital.hec.ca\/wp-content\/uploads\/2025\/09\/Favicone.png","contentUrl":"https:\/\/digital.hec.ca\/wp-content\/uploads\/2025\/09\/Favicone.png","width":512,"height":512,"caption":"HEC Montr\u00e9al"},"image":{"@id":"https:\/\/digital.hec.ca\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/fr-ca.facebook.com\/HECMontreal\/","https:\/\/www.youtube.com\/user\/HECMontreal"]},{"@type":"Person","@id":"https:\/\/digital.hec.ca\/en\/#\/schema\/person\/6aa8b76b6d7d5f96d83fd782014ce6e5","name":"allardfrederique","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/8226eafd98ddffeee0d09356272a5e359bd4875220a4f65aae0a2e657dcf33bb?s=96&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/8226eafd98ddffeee0d09356272a5e359bd4875220a4f65aae0a2e657dcf33bb?s=96&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/8226eafd98ddffeee0d09356272a5e359bd4875220a4f65aae0a2e657dcf33bb?s=96&r=g","caption":"allardfrederique"},"url":"https:\/\/digital.hec.ca\/en\/blog\/author\/allardfrederique\/"}]}},"views":48,"_links":{"self":[{"href":"https:\/\/digital.hec.ca\/en\/wp-json\/wp\/v2\/posts\/1922","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/digital.hec.ca\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/digital.hec.ca\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/digital.hec.ca\/en\/wp-json\/wp\/v2\/users\/692"}],"replies":[{"embeddable":true,"href":"https:\/\/digital.hec.ca\/en\/wp-json\/wp\/v2\/comments?post=1922"}],"version-history":[{"count":0,"href":"https:\/\/digital.hec.ca\/en\/wp-json\/wp\/v2\/posts\/1922\/revisions"}],"wp:attachment":[{"href":"https:\/\/digital.hec.ca\/en\/wp-json\/wp\/v2\/media?parent=1922"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/digital.hec.ca\/en\/wp-json\/wp\/v2\/categories?post=1922"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/digital.hec.ca\/en\/wp-json\/wp\/v2\/tags?post=1922"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}