Always Never Home

We help candidates land their dream Jobs, Internships, Grants, Scholarships and Graduate programs

Panel Integrity Manager at UsabilityHub

  • Full Time
  • Remote
  • Remote

Website UsabilityHub

Panel Integrity Manager at UsabilityHub
Manage our panel integrity team and continually improve our processes to ensure that our worldwide user research panel is providing trustworthy and high-quality feedback for our customers.

Who we are

Our remote UX research platform helps our customers take the guesswork out of design ideas by testing them with real people. We provide the tools and knowledge our clients need to unlock the power of design research and human-centred design. Our mission is to democratise design research by making it simple, affordable and fast. We’ve worked with some big names including Amazon, GoDaddy, and Zendesk in the 12 years we’ve been around. Our focus is now on growing our product offering and team to really deliver on that mission at scale.

Why we need you

Over the last five years we’ve organically grown a worldwide panel of over 300,000 people who participate in surveys and user research for our customers at UsabilityHub. A big part of our success has been ensuring that the feedback provided by our panel is of a high quality and that bad actors are quickly identified and removed. As our panel has grown, this workload has grown too, and it’s becoming increasingly important to improve the efficiency and effectiveness of our quality and fraud prevention team and processes. So we’re expanding that team and investing in our tools and processes, and we need you to lead the effort.

How we work

  • We’re a dedicated, growing team who are passionate about delivering value to our customers. 
  • We work hard and want to make an impact in the world, and recognise that comes with challenges that we deal with collaboratively and respectfully. 
  • We support each other and understand that individual success is dependent on the success of everyone else, so we invest in our personal and professional growth and consider learning, reflection, and up-skilling central to our jobs. 
  • We’re driven by Agile and Lean principles, working with Scrum and shipping value iteratively. 
  • We’re passionate about regularly adjusting and learning from feedback – both in terms of our customer value and our internal ways of working.

Who you are

  • You love taking on complex challenges and finding creative solutions.
  • You’re a people person who thrives on coaching team members from different backgrounds to excel individually and work well together as a team.
  • You’re good at making people feel welcome and appreciated.
  • You’re collaborative, happy to share work-in-progress, and keen to gather input from team members across the organisation.
  • You’re technically savvy. Maybe you have experience in online fraud detection, or if not, you’re familiar with the relevant technologies (VPNs, SMS verification, CAPTCHAs, etc).
  • You like to work iteratively, making small improvements frequently and learning as you go.
  • You’re customer focussed, able to put yourself in the customer’s shoes (or the panelist’s) and consider the impact of the decisions you make on them.
  • You’re analytical, seeking to quantify the impact of changes by taking measurements before and after whenever possible.
  • You’re comfortable working in a growing company where some things are still in flux.

Picture yourself in the role

If you were here this week, you would have:
  • Met with your team of panel integrity reviewers to discuss recent observations and hone our policies based on borderline cases they’ve noted since the last team meeting.
  • Reported on the team’s key metrics for the month, highlighting any interesting trends or changes.
  • Paired with Krystal (Customer Support Operations Lead, and current expert on fraud detection) to investigate a complex case and decide whether the panelist should be banned.
  • Met with Tristan (our COO) to plan the development of a new fraud detection method that you and your team think will improve the accuracy of their decisions.
  • Tracked down the source of a recent surge in panelist signups (turns out it’s a YouTube video about making money from home) and made sure that it was setting the right expectations for would-be panel members.
  • Joined a meeting with the product team to plan the rollout of a new feature, making sure you know how your team will adjust their response grading guidelines.
  • Had 1-on-1 catch ups with two members of the panel integrity team to check in on how they’re going, discuss any issues they’re facing and provide feedback and coaching.
  • Produced some new training material for new starters.
  • Onboarded a new team member, shadowing them on their first response grading session to help them apply the policies they’ve been learning on real panelist responses.

Keen to apply?

This role is open to candidates in Melbourne (our HQ) or remotely to candidates within Australia who are able to work AEST hours.

Please include answers to these questions in your cover letter:

  • What’s a great way you’ve found to build rapport and foster collaboration in a distributed team?
  • What’s something you’ve learned recently that changed the way you think about your work? What convinced you?
  • What kinds of quality and fraud issues do you think the panel integrity team probably address? We haven’t told you much yet—it’s okay to take a guess.

To apply for this job please visit usabilityhub.com.

Panel Integrity Manager at UsabilityHub
Share with someone
Scroll to top

Receive Job and Scholarship Alerts

X