Project Manager, QA Metrics
About the Company
Warner Bros. Discovery, a premier global media and entertainment company, offers audiences the world's most differentiated and complete portfolio of content, brands and franchises across television, film, streaming and gaming. The new company combines WarnerMedia's premium entertainment, sports and news assets with Discovery's leading non-fiction and international entertainment and sports businesses.
About WB Games Montréal
WB Games Montréal is a division of Warner Bros Interactive Entertainment (WBIE). Founded in 2010, we are 300+ creative team members strong who join forces every day to create unforgettable AAA experiences across all platforms.
Job Description
WB Games Montréal is looking for a Project Manager, QA Metrics.
Your New Role…
In this role, you will be responsible for providing accurate and predictive data analyses to support the Quality Assurance (QA) teams throughout the video game development cycle.
You will work closely with QA project managers to develop bug forecasts based on historical data, team composition, project milestones, and the complexity of deliverables.
You will play a key role in analyzing trends, updating predictive models, and communicating reliable data to executive teams, while also contributing to the continuous improvement of QA tracking tools.
Your Role Accountabilities...
- Design and maintain a suite of standardized automated dashboards across all projects displaying QA KPIs. Adapt these as needed to fit custom fields or workflows.
- Follow closely the progress of the assigned QA mandate with frequent reviews. Where necessary, escalate the risks to the Director of Quality Assurance and the Executive Producer / Sr. Producer of the Products they are responsible for.
- Build and maintain bug forecasting models for each title, based on historical data and information relevant to each unique title. Throughout development at major milestones, identify game components, areas or builds that have higher -or lower- than expected bug volume or coverage. Identify elements that may require more attention to contribute to balanced test coverage.
- Review and compare vendor performance across each title at each stage of development. Create reporting to review vendor KPI’s.
- Leverage and develop visually appealing, intuitive dashboards to effectively communicate insights.
- Work closely with QA Analytics team to visualize testing progression dashboards leveraging existing telemetry; champion new telemetry to fill important gaps.
- Stay current in terms of Automation best practices, capabilities and reporting, integrating automation results and coverage as a subset of overall coverage on our titles.
- Participate in the post-mortem process on each product at regular intervals (phases) provide detailed reports on failures, successes and recommendations going forward.
Qualifications & Experience…
- Bachelor’s degree in Statistics, Mathematics, or a related field, or equivalent ‘on the job’ experience with significant emphasis in the field of Statistics, Mathematics, Analytics
- 7+ years of QA and/or Production experience in software development and of which 3 years were in a project management capacity.
- A strong foundation in statistical methods and principles. This role is the Departmental leader in analyzing data and creating predictive models
- Previous experience in games industry in Production or QA fields a strong asset
- Resourceful – Able to research and troubleshoot issues solo
- Strong communicator, grasps and confirms understanding of requested reports. Likewise, reporting is clear and catered to its’ audience.
- Analytical thinker – understanding of data flow and dependencies
- Fluent in MDX (multidimensional expressions) language. Adept at creating custom calculations using MDX formulas.
- Ability to effectively use JavaScript to create custom fields and refine queries
- Experience with BI Tools such as Power BI an asset
- Keen interest in Software Defect Prediction (SDP) methodology
- Solid knowledge of Microsoft Office, including Word, Excel and PowerPoint etc.
- Excellent working knowledge of project management and testing tools. Mastery of JIRA and associated plugins. Comprehensive knowledge of eazyBI for Jira.
- In-depth understanding of formal test and development processes.
- Proven experience in risk management and mitigation across multiple large-scale projects.
- Talented evaluator of root cause issues and potential solutions.
- Process oriented, organized, flexible, and a high tolerance for stress.
- Excellent verbal, written, communication and presentation skills
- Strong negotiation, mediation and conflict resolution skills. Ability to interact and collaborate effectively with all disciplines at all levels.
- Multilingual, a desired asset (English/French bilingualism preferred)
