Specialist Evaluations Job

The Specialist, Evaluations is responsible for the management and technical oversight of critical evaluation projects and studies that contribute to strengthening and expanding IESO energy efficiency policies, programs and other strategic priorities that includes research on the advancement of evaluation, measurement and verification methods, protocols and procedures.  Examples of evaluation projects and studies include, but not limited to, non-energy benefits study, persistence of behavioural measures, incremental cost protocols, data-driven evaluation approach, updating and revision of the EM&V Protocols.

The Specialist, Evaluations is also responsible for leading the evaluation of special pilot programs and strategically focused initiatives.

The Specialist, Evaluations will ensure that the results of the evaluation projects and studies will translate to the enhancement of energy efficiency policies and protocols as well as EM&V methods, protocols and procedures.

What you'll do

• Conducts studies to monitor developments and trends in evaluation, measurement and verification. Provide recommendation to internal stakeholders and management on the relevance and value of the results to enhance and strengthen IESO’s energy efficiency policies and programs as well as EM&V methods, protocols and procedures in the form of reports, presentations, reviews and study results
• Prepare scope of work and get approval for each of the identified evaluation study/project citing the rationale, purpose, tasks, timeline and budget required by the study/project
• Maintain up-to-date knowledge of developments in advanced evaluation methods specifically for evaluating market-based programs. Peruse academic, technical and financial reports, studies, books, journals etc. dealing with various aspects of energy efficiency evaluation. Keep abreast of technological developments and best practices in the industry as they apply to energy efficiency program evaluation
• Manage third-party evaluation contractors procured to undertake the evaluation studies/projects such as the evaluation of the Energy Efficiency Auction pilot.
• Manage the third-party evaluation contractors while infield, reviewing their sampling plans for market research, engineering analysis, metering and data collection and statistical and technical analysis ensuring that the evaluation contractors carry-out evaluation plans in the most cost effective manner
• Develop Final Evaluation Plans in coordination with Evaluation Contractor
• Review and provide comments on interim and draft evaluation reports as well as evaluation study/project reports prepared by the Evaluation Contractors.
• Analyze and lead recommendations and reports on the evaluation and studies results
• Represent the Division or the IESO, as assigned, on committees, task forces and in various forums. Make presentations concerning evaluation methods, results or analytical studies which have impact on energy efficiency programs to internal and external groups, as needed
• Participate in public stakeholder events and sessions on evaluation results
• Follow up on stakeholder input and questions, developing responses for internal review on an ongoing basis
• Work collaboratively with other members of the team to effectively implement the goals of the team within the context of the broader corporate direction.
• Demonstrate by example the values of the IESO and the culture of the Energy Efficiency Group

Internal Contacts:

• Works with other groups and positions internally to resolve issues and work towards common goals (i.e., agreements on evaluation methods and solutions to problems)
• Provides guidance on how to use tools, respond to questions, presents findings to internal and external stakeholders, responds to LDC questions or complaints regarding reports or conclusions and recommendations, etc.)
• Draft RFPs and facilitate vendor procurement

External Contacts:

• Works together and resolves problems with evaluation contractors
• Coordinates public reporting of evaluation results, if needed
• Participates in public stakeholder events and sessions on evaluation results

What do you need to succeed

• 4-year University Degree in the areas of Engineering, Applied Physics, Environment, Mathematics, Economics or Statistics
• The minimum level of experience for the incumbent to perform at a satisfactory level of proficiency is 8-10 years including the period of adjustment on the job itself
• Direct experience in program evaluation and monitoring, ideally within an energy context
• Solid background and grounding in energy conservation and/or energy issues; knowledge of IESO’s conservation initiatives is an asset
• Strong knowledge (particularly energy sector knowledge) of the principles of program evaluation research, design and statistics including techniques used to estimate gross versus net program benefits

Competencies:

• Action Oriented
• Approachability
• Customer Focus
• Functional/Technical Skills
• Learning on the Fly
• Priority Setting
• Problem Solving
• Self-Development

What’s in it for you:

• A comprehensive total rewards program, including best-in-class benefits and a flexible workplace
• A challenging, fast-paced and collaborative team environment, where your perspectives and experiences matter
• Leaders who support your growth and success through regular feedback and coaching
• The opportunity to work with some of the brightest minds in the industry