Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add survey questions #77

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
99 changes: 99 additions & 0 deletions User Engagement Lead/survey_questions.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,99 @@
# Survey questions

## Readme

This survey aims at evaluating users’ experiences with ESMValTool and
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we also articulate some outcomes we want to achieve, something more specific than is in the text?

discovering users’ needs. It is meant for the users of ESMValTool in all levels
of expertise. Some criteria to design the questions:

- It does not take more than 10 (?) minutes
rswamina marked this conversation as resolved.
Show resolved Hide resolved
- It does not have overlapping questions
- It does not include questions with yes/no answers
- It does not collect personal data, but it has some profiling questions
- It covers different aspects of ESMValTool like application, usage, documentation and community

The survey can be implemented in a survey app like surveymonkey that does not
collect personal data. The owner is “user engagement team”. They will
edit/run/evaluate the survey and communicate the results to other teams if
needed.

## Survey content

Hi! We in [ESMValGroup](https://www.esmvaltool.org/), would love to hear about
SarahAlidoost marked this conversation as resolved.
Show resolved Hide resolved
your research and experiences using ESMValTool. Your answers will help us to
improve ESMValTool and hence enhance the science that you conduct. All responses
are recorded anonymously.

**Describe your research/case study and challenges:**

1. Can you describe your research/case study with respect to data processing?
2. Can you underline the challenges in your research/case study with respect data handling?
3. How would you categorize your expertise level in using ESMValTool? (Beginner,
competent practitioner, expert)
SarahAlidoost marked this conversation as resolved.
Show resolved Hide resolved

**Software:**

ESMValTool provides many recipes (scientific workflows), features and functions to analyze data for Earth system
models. See the [list of preprocessors](https://docs.esmvaltool.org/projects/esmvalcore/en/latest/recipe/preprocessor.html#preprocessor)
and [list of recipes](https://docs.esmvaltool.org/en/latest/recipes/index.html).

4. Which recipes/preprocessors in ESMValTool have you found to be most useful for your
research/case study?
5. How satisfied are you with the software's:
SarahAlidoost marked this conversation as resolved.
Show resolved Hide resolved
- Ease of use (1-10)
- Development workflow (1-10)
- Reliability (1-10)

**Documentation:**

ESMValTool [documentation](https://docs.esmvaltool.org/en/latest/) covers
different aspects of research: How the code works, how to obtain and process
data, and what are best practices in developing code.If you are familiar with
the documentation, please tell us:

6. What aspects or specific sections if any did you find most useful in the documentation?
7. What topics are missing that you want to learn about?
8. How much do you agree with the following statements?
- It is easy to find relevant information from the documentation. (1-10)
- The instructions in the documentation are complete and easy
to follow. (1-10)

**Tutorial:**

There is also an online
[tutorial](https://esmvalgroup.github.io/ESMValTool_Tutorial/) that shows not
only how to run an experiment but also how to develop your own code. If you are
familiar with the tutorial, please tell us:

9. What aspects or specific sections if any did you find most useful in the tutorial?
10. What topics are missing that you want to learn about?
11. How much do you agree with the following statements?
- The instructions in the tutorial are complete and easy
to follow. (1-10)
- I can immediately apply what I learned from the tutorial. (1-10)

**Community:**

ESMValTool provides [different
platforms](https://docs.esmvaltool.org/en/latest/introduction.html#support) to
communicate with users and researchers: mailing list, github issues, discussion
page.

12. Which platform are you familiar with: (multiple questions)

- [User mailing list](https://docs.esmvaltool.org/en/latest/introduction.html#user-mailing-list)
- GitHub issues
- Discussion page
- ESMValTool Website https://esmvaltool.org/
- Twitter https://twitter.com/esmvaltool

13. If you have used any of these, please tell us how much you agree with
the following statements?
- I felt comfortable asking my questions using these platforms. (1-10)
- I was able to get clear answers to my questions from the community. (1-10)

SarahAlidoost marked this conversation as resolved.
Show resolved Hide resolved
**Other**

What suggestions do you have for improvements, or any other relevant input for us?

Thank you for helping us to build the ESMValTool that you like.