  During a public health crisis like the COVID-19 pandemic, a credible and
easy-to-access information portal is highly desirable. It helps with disease
prevention, public health planning, and misinformation mitigation. However,
creating such an information portal is challenging because 1) domain expertise
is required to identify and curate credible and intelligible content, 2) the
information needs to be updated promptly in response to the fast-changing
environment, and 3) the information should be easily accessible by the general
public; which is particularly difficult when most people do not have the domain
expertise about the crisis. In this paper, we presented an expert-sourcing
framework and created Jennifer, an AI chatbot, which serves as a credible and
easy-to-access information portal for individuals during the COVID-19 pandemic.
Jennifer was created by a team of over 150 scientists and health professionals
around the world, deployed in the real world and answered thousands of user
questions about COVID-19. We evaluated Jennifer from two key stakeholders'
perspectives, expert volunteers and information seekers. We first interviewed
experts who contributed to the collaborative creation of Jennifer to learn
about the challenges in the process and opportunities for future improvement.
We then conducted an online experiment that examined Jennifer's effectiveness
in supporting information seekers in locating COVID-19 information and gaining
their trust. We share the key lessons learned and discuss design implications
for building expert-sourced and AI-powered information portals, along with the
risks and opportunities of misinformation mitigation and beyond.
