Program Highlights | Keynote Speaker | Schedule | Sponsor | Past Conferences | Contact
Step into the future of online research
At this virtual event, hosted by CloudResearch, we promise to bring together innovative minds from across the research spectrum for an enriching and enlightening experience. Our goal is to foster collaboration, share knowledge, and inspire attendees with best practices in online research through a blend of illuminating talks, interactive workshops, and high-quality networking opportunities. IIOR also offers valuable insights into CloudResearch’s products, including Connect, Prime Panels, Managed Research, and Sentry.
Program Highlights
- Keynote address by Dr. Sean Westwood, Associate Professor in the Department of Government at Dartmouth College and Director of the Polarization Research Lab
- Deep dive into data quality led by renowned experts
- An exploration of research complexities across different study types
- Meet high-quality participants from Connect and learn from their firsthand experiences
- Hear from our CloudResearch grant recipients and get inspired by their work
A unique feature of the Innovations in Online Research conference is our focus on interactivity. We encourage attendees to actively engage in Q&A sessions, panel discussions, and breakout groups to discuss key learning points and challenges they face in their own research.
Keynote Speaker: Dr. Sean Westwood
Dr. Sean Westwood is an Associate Professor in the Department of Government at Dartmouth College and Director of the Polarization Research Lab. Dr. Westwood’s main area of research is political behavior and public opinion, specifically focusing on how partisanship and information from political elites affect the behavior of citizens. His keynote address will debunk the perceived high support for politically motivated violence in America, demonstrating through extensive survey experiments that such support is notably low due to factors such as respondent disengagement and ambiguous survey questions.
Learn more about Dr. Sean WestwoodSchedule*
8:30 – 9:30 AM Keynote Address
From Perception to Reality: Measuring Rare Attitudes in U.S. Political Violence
Political scientists, pundits, and citizens worry that America is entering a new period of violent partisan conflict. Provocative survey data show that a large share of Americans (between 8% and 40%) support politically motivated violence. Yet, despite media attention, political violence is rare, amounting to a little more than 1% of violent hate crimes in the United States.
In this insightful keynote address, Dr. Sean Westwood will present data from four extensive online survey experiments involving nearly 5,000 participants to reconcile these seemingly conflicting facts. As Dr. Westwood will demonstrate, respondent disengagement, random responding, and ambiguous survey questions drastically overinflate the support for partisan violence. In fact, when using proper data quality measures, support for partisan violence is vanishingly low, and nearly all respondents support criminally charging suspects who commit acts of political violence. These findings suggest that although recent acts of political violence dominate the news, they do not portend a new era of violent conflict.
For researchers across all fields, this keynote promises to be an essential learning experience. Join us as we untangle this complex issue, addressing the disparity between perception and reality. Gain invaluable insights into the critical role of data quality in social science research and its effects on public opinion and policy.
9:30 AM – 9:45 AM Coffee Break
Take a quick break and a sip of coffee! 🙂 ☕️
9:45 AM – 11:15 AM Data Quality Panel
Delve into the intricacies of data quality with our expert panel including Dr. Sara Jaeger, Dr. Catherine Marshall, Dr. Leib Litman, and Dr. Aaron Moss in a 1.5-hour-long interactive session. The panel will discuss pivotal questions such as measurement methods for data quality, the comparison of attention checks vs digital fingerprinting, and more. Following the panel discussion, attendees will participate in breakout sessions to discuss key takeaways, disagreements, current challenges, and potential strategies for enhancing data quality. The session will conclude with a lively discussion and open Q&A, providing an opportunity to share insights from the breakouts and field additional questions.
11:15 AM – 11:30 AM Coffee Break
Take a quick break and a second sip of coffee! 🙂 ☕️
11:30 AM – 12:00 PM Participant Panel
Experience first-hand insights from participants in a 30-minute panel discussion. We’ll be bringing together 3-5 high-quality participants from the Connect platform to voice their experiences, likes, and dislikes about using the platform and participating in studies. The session will open up for a Q&A, offering attendees a unique opportunity to directly engage with, and learn from, the experiences of the participants themselves.
The panel will be moderated by Caitlin Harrington, a staff writer at WIRED who covers the intersection of technology, corporate practices, and workers’ rights, with a keen focus on the societal implications of tech giants’ business decisions. One of Harrrington’s latest articles is a deep dive into the way ChatGPT is reshaping crowd work.
Caitlin Harrington
12:00 PM – 12:30 PM Lunch Break
That is one jam-packed morning! Let’s pause and reflect over lunch (BYOL).
12:30 PM – 2:00 PM Navigating Complex Sampling
Unravel the complexities of research design in our ‘Navigating Research Complexity’ session. The session will commence with a 30-minute overview, followed by an hour-long breakout with a choice between three sessions: Dyadic studies, Longitudinal + Clinical studies, or Qualitative studies. Each session will delve into examples, challenges, and best practices. Attendees will regroup for a Q&A, promoting the exchange of insights and collaborative problem-solving.
Dyadic Studies: This breakout session focuses on collecting dyadic or group data online in diverse contexts including menopausal women and their partners (Yating Yang), how to study conversations online (Mike Yeomans), the use of the Online Coalition Game for studying politics (Anabela Cantiani), and the use of ChatPlat for studying political polarization (Trevor Spelman)
Longitudinal Studies and Clinical Samples: This session explores how to sample patients for longitudinal health behavior studies (Dr. Laura Downey), using a prospective cohort design to study shifts in risk perception regarding COVID-19 (Soyeon Choi), collecting online data for eating disorders research (Dr. Sarah Weinberger-Litman), and using audio recordings to study suicidality among veterans (Dr. Yosef Sokol).
Qualitative Research Online: In this session, the connection between medical mistrust and lung cancer screening inequities in the US is explored through online interviews and focus groups with a diverse audience (Dr. Jennifer Richmond). The subsequent talk addresses challenges posed by AI tools, such as ChatGPT, in online qualitative research and the importance of clear guidelines to prevent unauthorized AI usage (Dr. Leib Litman). The final talk highlights the method of accessing rare patient populations online, specifically chronic refractory migraine sufferers (Dr. Zohn Rosen).
2:00 PM – 2:15 PM Coffee Break
One last sip of coffee! 🙂 ☕️
2:15 PM – 3:30 PM CloudResearch Deep Dive
Join us for a ‘CloudResearch Deep Dive’, a comprehensive 1-hour session designed to help you gain a deeper understanding of our platforms. The session kicks off with a 30-minute demo of our flagship services – Connect, Prime Panels, and Managed Research, offering a glimpse into their advanced capabilities. Following the demo, we will open the floor for a 30-minute interactive Q&A session, providing attendees with the opportunity to dive deeper into the specifics of these services.
3:30 PM – 4:30 PM Grant Recipients
Meet and interact with our esteemed past and present Grant Recipients. This session will provide an opportunity to gain insights from the journeys of successful grantees, understanding their challenges, strategies, and their innovative research work. It’s a chance to connect, learn, and maybe even be inspired for your own future grant applications.
2023 Grant Recipients
Brad Huang: Unlocking Creativity with Artificial Intelligence: Experimental Evidence from ChatGPT on the Goldilocks (Curvilinear) Effect of Human–AI Collaboration
2022 Grant Recipients
4:30 PM – 5:00 PM Besample Demo
Sampling Beyond WEIRD: Attentiveness, Honesty, Reliability, and Overall Quality in Non-Western Research Participants
Besample, a new platform for behavioral research in non-WEIRD populations, will share results of internal quality assessment of 250,000 research participants from Africa, Asia, Latin America, and Eastern Europe, along with tips on collecting data in non-Western countries and a special small grant program for researchers willing to go beyond WEIRD.
Speakers
5:00 PM – 5:30 PM Social Event
Wind down at our Social Event. This will be the perfect opportunity to discuss main takeaways from the event, network with fellow attendees, and engage in an open Q&A. Share your thoughts and experiences from the conference, and perhaps spark insightful discussions with other passionate professionals.
*Schedule is subject to change
Sponsor
Meet our sponsor Besample: a brand-new data collection platform for researching beyond the West. Recall that classic estimation that 96% of all psychology findings were based on WEIRD research populations (Henrich et al., 2010)? Besample was created to change this by giving scholars quick, easy, and affordable online access to quality research participants from 42 diverse countries, such as Uzbekistan, Kenya, Colombia, or Bangladesh. Don’t miss out on grant opportunities! Besample supports scholars in their effort to go beyond WEIRD. Are you a graduate student, postdoc, or young faculty? Apply for a grant of up to $250 to collect your first international dataset.
Registration for the 2023 IIOR conference is now closed.
For updates about the 2024 IIOR conference, enter your information below:
Past Conferences
Recordings from the 2023 IIOR conference will be available in the upcoming weeks. Stay tuned!
We have hosted the Innovations in Online Research Conference for three consecutive years! If you missed the past conferences, or would like a refresher before our 2023 conference, you can view recordings from past conferences here:
- 2022
- The day was filled with interesting and informative sessions on topics ranging from data quality to collecting niche samples and applying innovative technologies to online research methods
- The keynote address was delivered by Dr. Joseph Cimpian (NYU) on how mischievous respondents create biased data, particularly among vulnerable groups such as LGBTQ youth
- CloudResearch staff gave workshops on Connect, Prime Panels, and Sentry
- Throughout the conference, attendees connected with other researchers collecting online data, sparking new ideas and promising avenues for future work
- We appreciate all our speakers and attendees and look forward to seeing you again next year!
- 2021
- Dr. Jesse Chandler gave a keynote on “The Fulfilled and Unfulfilled Promises of Amazon Mechanical Turk.” Anyone who’s used MTurk will enjoy this look at its rise and current status
- During our Careers in Industry Panel, Kate Rogers (Zillow) and Ryne Sherman (Hogan Assessments) spoke about work in industry. Among their tips for people interested in industry were internships, making your resume skills-oriented, and not underestimating yourself!
- At the CloudResearch Grant Awards Ceremony, we awarded $10K in research grants and celebrated the winners of our contest—Art Marsden of Syracuse University, Michiel Spapé of University of Helsinki, Nick Byrd of Stevens Institute of Technology, and Megan Burns of NYU. Learn more about their research projects.
- 34 amazing talks were shared related to online research and innovation. Talks ranged from data quality, to video interviews, new online methods, ethics, polling, social media recruitment, research during COVID, and longitudinal studies.
Contact Us
For more information about the 2023 Innovations in Online Research (IIOR) Conference, or any related queries, we’re here to help! Email Rachel Hartman, our Director of Academic Operations.
We look forward to hearing from you and hope to see you at the conference!
