Online since 2002. Over 3300 puzzles, 2600 worldwide members, and 270,000 messages.

TwistyPuzzles.com Forum

It is currently Wed Apr 23, 2014 1:37 pm

All times are UTC - 5 hours



Post new topic Reply to topic  [ 18 posts ] 
Author Message
 Post subject: TwistyPuzzles.com Research
PostPosted: Mon Apr 08, 2013 1:49 pm 
Offline
User avatar

Joined: Sun Feb 13, 2011 9:16 am
Location: Indiana
Hey everyone! I'm doing an a study on the TwistyPuzzles community for an academic project and I need your help to gather some research. I've created a survey with a few simple questions to generate data on how the site is used in general and how that relates to puzzle designs.

I would greatly appreciate it if you could take a moment of time to take my survey, linked below:

Survey Closed.

Feel free to leave any comments about the survey as replies.

Thanks! :solved:

EDIT: Thank you for your responses! This is better than I could have hoped for. Keep them coming TP <3.

RESULTS


Attachments:
TPResults.pdf [228.89 KiB]
Downloaded 35 times

_________________
-Jack Lopez


Last edited by Jack Lopez on Tue Apr 16, 2013 9:00 am, edited 5 times in total.
Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Mon Apr 08, 2013 2:31 pm 
Offline
User avatar

Joined: Mon Mar 30, 2009 5:13 pm
Done! :)

_________________
If you want something you’ve never had, you’ve got to do something you’ve never done - Thomas Jefferson


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Mon Apr 08, 2013 2:31 pm 
Offline
User avatar

Joined: Thu Dec 31, 2009 8:54 pm
Location: Bay Area, California
Your survey is very design-centric. Only folks that have have done design work and performed mods really qualify to answer. Also, you don't make any distinction between modifications, design from scratch, and work on other's designs. You also don't make the distinction between creation of new physical puzzles versus new puzzle concepts or software-based puzzles.

For the purpose of your survey are conceptual folks and programmers like Gelatinbrain and schuma and GuiltyBystander and wwwmwww doing design work?

_________________
Prior to using my real name I posted under the account named bmenrigh.


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Mon Apr 08, 2013 2:46 pm 
Offline
User avatar

Joined: Mon Mar 30, 2009 5:13 pm
bmenrigh wrote:
Your survey is very design-centric. Only folks that have have done design work and performed mods really qualify to answer. Also, you don't make any distinction between modifications, design from scratch, and work on other's designs. You also don't make the distinction between creation of new physical puzzles versus new puzzle concepts or software-based puzzles.

For the purpose of your survey are conceptual folks and programmers like Gelatinbrain and schuma and GuiltyBystander and wwwmwww doing design work?

Perhaps the scope of his project has nothing to do with these aspects, and is intentionally limited to design?

Mind you, most surveys are poorly designed in my experience, asking questions in a way that won't answer the questions intended, by making the kind of assumptions you indicated...

_________________
If you want something you’ve never had, you’ve got to do something you’ve never done - Thomas Jefferson


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Mon Apr 08, 2013 2:54 pm 
Offline
User avatar

Joined: Sun Feb 13, 2011 9:16 am
Location: Indiana
bmenrigh wrote:
Your survey is very design-centric. Only folks that have have done design work and performed mods really qualify to answer. Also, you don't make any distinction between modifications, design from scratch, and work on other's designs. You also don't make the distinction between creation of new physical puzzles versus new puzzle concepts or software-based puzzles.

For the purpose of your survey are conceptual folks and programmers like Gelatinbrain and schuma and GuiltyBystander and wwwmwww doing design work?


Yes, it is very design-centric. It does seem odd to answer the first two questions as "No" and leave the rest of the survey blank, but that is just as valuable to me as the other responses. It helps be gauge a rough percentage of users that design and/or submit their designs. As for "designs", I'm not very concerned about the distinction between types. While they can be very different, the general process from concept to creation is similar among them.

I'm mainly trying to investigate the influence of the site/community on the designs submitted here.

For clarification on the more conceptual/programming side, that would certainly fall under the "or puzzle ideas" part of question 2. I'm absolutely interested in the input from these users.

Thank you so much for your feedback! I hope I clarified. It would be interesting to do another (more general, publicly-viewable) survey if that piques anyone's interest.

_________________
-Jack Lopez


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Mon Apr 08, 2013 2:56 pm 
Offline
User avatar

Joined: Sun Feb 13, 2011 9:16 am
Location: Indiana
KelvinS wrote:
bmenrigh wrote:
Your survey is very design-centric. Only folks that have have done design work and performed mods really qualify to answer. Also, you don't make any distinction between modifications, design from scratch, and work on other's designs. You also don't make the distinction between creation of new physical puzzles versus new puzzle concepts or software-based puzzles.

For the purpose of your survey are conceptual folks and programmers like Gelatinbrain and schuma and GuiltyBystander and wwwmwww doing design work?

Perhaps the scope of his project has nothing to do with these aspects, and is intentionally limited to design?

Mind you, most surveys are poorly designed in my experience, asking questions in a way that won't answer the questions intended, by making the kind of assumptions you indicated...


Yeah, first time designing a survey... We spoke about these things in class but it can still be difficult to design the questions properly. Looks like I'll have more to write about!

_________________
-Jack Lopez


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Mon Apr 08, 2013 3:02 pm 
Offline
User avatar

Joined: Mon Mar 30, 2009 5:13 pm
Jack Lopez wrote:
I'm mainly trying to investigate the influence of the site/community on the designs submitted here.

As with most surveys, the open question at the end will probably give you the richest and most insightful information, much more than all the fixed multiple choice options.

In other words, the best way to get the answer to your main question, is just to ask it!!

_________________
If you want something you’ve never had, you’ve got to do something you’ve never done - Thomas Jefferson


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Mon Apr 08, 2013 3:15 pm 
Offline
User avatar

Joined: Sun Feb 13, 2011 9:16 am
Location: Indiana
KelvinS wrote:
Jack Lopez wrote:
I'm mainly trying to investigate the influence of the site/community on the designs submitted here.

As with most surveys, the open question at the end will probably give you the richest and most insightful information, much more than all the fixed multiple choice options.

In other words, the best way to get the answer to your main question, is just to ask it!!


I agree with you 100%. As much as I would love to, I am required to do a certain number of close-ended questions. As for more open- ended questions, I also have to conduct interviews in addition to my research. I'm planning to PM some of the more consistent contributors from the different subforums to get open-ended responses from them.

_________________
-Jack Lopez


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Mon Apr 08, 2013 4:12 pm 
Offline
User avatar

Joined: Thu Dec 31, 2009 8:54 pm
Location: Bay Area, California
Jack Lopez wrote:
[...]It does seem odd to answer the first two questions as "No" and leave the rest of the survey blank, but that is just as valuable to me as the other responses. It helps be gauge a rough percentage of users that design and/or submit their designs.

Surveys are extremely hard to design right. I don't think your survey can say anything about the percentage of users that are designers.

For example, more non-members read the forum than logged in members. You did not ask if a user is a member of the forum.

Also, the core group of very active users that read the site multiple times a day is very small. There will be an inherent self-selection bias towards very active members and non-members. You can't assume a random sample. Also, the member count is currently 2913 but the number of users that have made more than 10 posts or logged in in the last year is much lower.

If you get too-few responses you'll need to use statistics for discrete outcomes rather than continuous distribution or possibly Student's t-distribution.

You should always keep 1) the limitations of your survey, 2) statistical significance and 3) sources of bias in mind when drawing any conclusions from survey answers.

_________________
Prior to using my real name I posted under the account named bmenrigh.


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Mon Apr 08, 2013 4:36 pm 
Offline
User avatar

Joined: Mon Mar 30, 2009 5:13 pm
... and read Thinking, Fast and Slow by Daniel Kahneman!

_________________
If you want something you’ve never had, you’ve got to do something you’ve never done - Thomas Jefferson


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Mon Apr 08, 2013 4:39 pm 
Offline
User avatar

Joined: Thu Dec 31, 2009 8:54 pm
Location: Bay Area, California
KelvinS wrote:
... and read "Thinking, Fast and Slow" by Daniel Kahneman!

I'm a bit more than halfway through it :D Your post about it made me move it ahead of "The Theoretical Minimum" by Susskind and Hrabovsky. I'm really enjoying it. I have a few quibbles with some of his example studies but overall it's really fantastic and quite eye-opening.

_________________
Prior to using my real name I posted under the account named bmenrigh.


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Mon Apr 08, 2013 4:48 pm 
Offline
User avatar

Joined: Mon Mar 30, 2009 5:13 pm
bmenrigh wrote:
KelvinS wrote:
... and read "Thinking, Fast and Slow" by Daniel Kahneman!

I'm a bit more than halfway through it :D Your post about it made me move it ahead of "The Theoretical Minimum" by Susskind and Hrabovsky. I'm really enjoying it. I have a few quibbles with some of his example studies but overall it's really fantastic and quite eye-opening.

For me it has been absolutely enlightening: helping to understand the way we think and understand (or rather misunderstand!) the world around us...

_________________
If you want something you’ve never had, you’ve got to do something you’ve never done - Thomas Jefferson


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Tue Apr 09, 2013 3:04 am 
Offline
User avatar

Joined: Sun Mar 15, 2009 12:00 am
Location: Jarrow, England
The issue of survey design was brought up in the BBC comedy series Yes Prime Minister. Sir Humphrey was explaining to Bernard how you could get any answer you wanted from a public survey depending on how the lead-up questions were put. Thus, if the issue was whether the government should introduce National Service (compulsory military training for young people) or not, you could get either a NO or YES consensus as follows:

Questions A

  • Are you worried about the number of young people without jobs?
  • Are you worried about the increase in drugs and crime committed by teenagers?
  • Are you concerned about the lack of discipline in our schools?
  • Do you think that young people would welcome some authority and leadership in their lives?
  • Do you think young people would respond to a challenge?
  • Would you vote in favour of compulsory military service?

Questions B

  • Are you concerned about the danger of a terrorist war?
  • Are you worried about the growth of the weapons industry?
  • Are you concerned about the increasing availability of firearms on the street?
  • Do you think there is danger in teaching people how to use guns to kill people?
  • Do you think it’s wrong to force people to take up arms against their will?
  • Would you vote against compulsory military service?

I think that most perople would tend to answer yes to both sets of questions :lol:

Also, as well as carefully designing the questions, whenever I see people taking surveys in the street, I notice that they only stop certain people, as they are instructed to look for a specific demographic for that particular survey. After all, it it no use only asking older people about whether state pensions should be increased if you want a NO answer!

_________________
My Shapeways Shop: http://www.shapeways.com/shops/gus_shop

Image


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Tue Apr 09, 2013 5:54 am 
Offline
User avatar

Joined: Mon Mar 30, 2009 5:13 pm
So is this the wrong forum to survey to get support for my proposed ban of all things twisty, or do I just need to ask really cunning lead questions, like "would you agree that youngsters are losing the ability to socialise and need to spend less time playing computer games and puzzles on their own"? :lol:

_________________
If you want something you’ve never had, you’ve got to do something you’ve never done - Thomas Jefferson


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Tue Apr 09, 2013 6:42 am 
Offline
User avatar

Joined: Sun Mar 15, 2009 12:00 am
Location: Jarrow, England
KelvinS wrote:
"would you agree that youngsters are losing the ability to socialise and need to spend less time playing computer games and puzzles on their own"? :lol:
Youngsters! What about us oldsters :shock:

_________________
My Shapeways Shop: http://www.shapeways.com/shops/gus_shop

Image


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Tue Apr 09, 2013 6:55 am 
Offline
User avatar

Joined: Wed Dec 10, 2008 6:26 pm
Location: Boston area
Survey completed.

I'm very curious to see the results, hopefully you'll post them once they are compiled.

_________________
Visit Pitcher Puzzles where you can buy the IPP award-winning RotoPrism 2, Fracture-10, and many, many more.


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Tue Apr 09, 2013 2:19 pm 
Offline
User avatar

Joined: Sun Feb 13, 2011 9:16 am
Location: Indiana
David Pitcher wrote:
Survey completed.

I'm very curious to see the results, hopefully you'll post them once they are compiled.


I really don't see why I couldn't post the raw results. I think I would avoid posting all of the free responses to ensure anonymity and keep things more organized. I have plenty of responses to carry out my project, so I'll probably post the results on Sunday or so.

_________________
-Jack Lopez


Top
 Profile  
 
 Post subject: Re: TwistyPuzzles.com Research
PostPosted: Mon Apr 15, 2013 12:52 pm 
Offline
User avatar

Joined: Sun Feb 13, 2011 9:16 am
Location: Indiana
Results have been posted! Free responses were left out for anonymity. Click the link to the Google Doc or download the PDF attached to the original post!

RESULTS

_________________
-Jack Lopez


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 18 posts ] 

All times are UTC - 5 hours


Who is online

Users browsing this forum: No registered users and 8 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  

Forum powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group