Billy Shih


Former Senior Optimization Analyst, Webtrends

5 quick tips to effective A/B and A/B split testing

December 5th, 2007

Topics: Methodology

While multivariate might be the hottest testing subject, you can’t beat a good split test in certain situations. If you already know the difference between A/B and A/B split tests, skip this part, otherwise it’s a quick read. A/B testing is when you test one page then replace it with a new page, so the

Read more

Billy Shih


Former Senior Optimization Analyst, Webtrends

Getting Cultured in Testing

December 5th, 2007

Topics: Methodology

“I only need to run my analytics for one month because it’s not going to be different next month.” I think saying that would get any online marketer fired. So why do I encounter people that assume they only need to test pages once? This is beginner level testing methodology. Every online business needs to

Read more

Billy Shih


Former Senior Optimization Analyst, Webtrends

Two types of tests (and I’m not talking MV or Split)

November 28th, 2007

Topics: Methodology

There are a lot of things to know to be a pro at testing, so I’ll cover some of the basics every week. Hopefully I’ll have a nice inventory of posts that can be used as a resource for you or anyone else to quickly learn the testing language and methods. A good starting point

Read more

Billy Shih


Former Senior Optimization Analyst, Webtrends

Why test?

November 27th, 2007

Topics: Methodology

I love web designers and creative people. They create beautiful things out of words and ideas we give them, yet still have to deal with people judging every little thing they put out into the world. Working on company websites is especially an ordeal. Everyone has an opinion, from CEO to marketer, but really who

Read more