Dear Ifigenia, Sivan and all,
to be honest I wasn’t aware of the SUS label, but the concept is right.
That set of questions come from the need to create a “participant survey” as required by the proposal, which could also serve to evaluate the overall platform during piloting and testing.
However, there are currently 15 questions in the matrix, so if everyone agrees I could cut them to 10 to make it simpler and adapt to the SUS methodology.
Another option might be to remove this matrix from the surveys addressed externally (i.e. SMEs and VET) and leave it only for our internal testing (i.e. the third survey dedicated to project partners).
Reduction of questions in the second matrix + indication of the unit number -> yes, this could be easily adjusted too.
On a more practical side, I have just found out that unfortunately the free version of LimeSurvey allows us only 25 responses per survey created. I’m sorry, I wasn’t aware of that.
Do someone of you (maybe the partners more expert in the FOSS world) have any advice on other free and open source tool to create online surveys that could be fit for our purpose?
Thank you,
Francesco Agresta
European Project Manager
European Digital Learning Network
Via Domenico Scarlatti, 30
20124 Milano
Mob. +39 3496027623
Email francesco.agresta@dlearn.eu
www.dlearn.eu
Dear all,
If I get it right, these questions come from SUS (eg. https://www.usability.gov/how-to-and-tools/methods/system-usability-scale.html) and, thus, should be used as they are, if we want to derive a result on the usability, based on the scale of this methodology. The intention is for the same issue to be addressed/asked in both a “positive” and “negative” way, in order to make sure that the user has a clear understanding and does not respond mechanically. Again, I am not that deep in the project, you know best.
Best regards,
Ifigeneia
I agree with Jonas and Björn that the number of questions could become an issue to for the response rate. Specifically, in the matrix, there is some potential to remove questions that look at the same aspect from a different angle.
"The learning platform was easy to use" and "I found the learning platform unnecessarily complex"
-> a similar and could be one question
"I felt very confident using the platform"
-> not sure if the confidence of the reader is relevant for us
There are also some formatting issues where there seems automated hyphenation (line breaks within one word) happening which does not help ease of reading.
I don't know if it will be possible, but maybe you can also reduce the questions for the different units of the course? A help could also be to add the number of the unit so it's a bit clearer.
On Tue, 2019-06-18 at 18:15 +0200, Francesco Agresta wrote:
Dear Jonas and Bjorn,
thank you for your prompt and valuable feedback.
Il 18 giugno 2019 alle 17.33 Jonas Gamalielsson <
jonas.gamalielsson@his.se
> ha scritto:
We have checked the three surveys and notice that the text for questions
are right justified, and we think they should be left justified. Several
questions have formatting issues which may significantly inhibit
respondents from filling in the survey.
I see, I didn't select a right justification so I guess that the Limesurvey system did it automatically. I have started to use it only recently, so I can try to fix it.
We don't understand how the questions on the survey page "FOSS4SMEs
Impact" relate to impact.
In general, few questions actually address the purpose of the survey, as
stated on the first page of the survey(s): "This survey has been
developed to assess the impact of the FOSS4SMEs main outputs on
participating SMEs.". Most questions are at the level of the individual
experiences rather than at the organisational (SME) level.
I get your point, which is all the way reasonable. However, I believe that we have to keep in mind the scope of this project and our present status. Do you believe it would be possible to report on an impact at organisational level over the remaining implementation time, also given the fact that the course has still not be released?
I can't see this happening right now, but please give me input if I'm wrong. This is why I thought the easiest way to get away with this task would be to keep an individual approach.
Further, we fear that the large number of questions may reduce the
response rate.
I could take out some of the questions in the two matrixes, but I'm afraid the free-text questions at the end of the survey have to stay because they are specifically asked in the proposal.
We also find that there is a significant risk for low response rate, in
particular for SMEs, when using an online survey tool. Hence, it would
be appropriate to also provide an offline alternative (e.g. in the form
of an ODS template that is provided to potential respondents so that
respondents can fill it in, print it, and sent it back via post
(landmail/airmail) to address privacy concerns).
I developed an online survey because we thought with Katerina it would have made easier the dissemination of the questionnaire and the collection/analysis of responses. However, if you think you'll need an .odt version of it for the SMEs, that's not going to be an issue.
Best,
Francesco
On 2019-06-14 18:44,
francesco.agresta@dlearn.eu
wrote:
Dear partners,
I’m sending here the links for three impact surveys we are supposed to
send out and have filled in during these final months until the end of
the project.
They relate to three different target groups:
1. SMEs
https://foss4smes.limequery.com/1?lang=en
2. VET Centres, Trainers and Coaches7
https://foss4smes.limequery.com/2?lang=en
3. Project partners (i.e. ourselves)
https://foss4smes.limequery.com/3?lang=en
The fourth target group to be surveyed will be “Other stakeholders”
(e.g. policy makers in digital education). They will be part of a
“formal consultation based on Intellectual Output 3”, which is still
under development.
However, this fourth group will be most probably approached exploiting
the occasion of the final conference in Brussels.
In addition, please find attached a template for the collection of SMEs
case studies showcasing the participants experience and improved
performance. We are supposed to collect 5 case studies per partner, 30
in total.
These activities relate to the “Impact” strategy described at page 62-63
of the proposal.
I have started updating the Quality Plan accordingly with all the
necessary information (you will find it in keybase), and it will be
finalised as soon as we are done also with the 4^th target group and the
self-diagnostic tool (which is supposed to depict the “before” situation
about participants).
Please have a look at the surveys and we will discuss them during our
monthly call coming next Tuesday.
Wish you a nice weekend,
Descrizione: Descrizione: dlearn <
http://www.dlearn.eu/
>
Francesco Agresta
European Project Manager
European Digital Learning Network
Via Domenico Scarlatti, 30
20124 Milano
Mob. +39 3496027623
Email
francesco.agresta@dlearn.eu
<mailto:
francesco.agresta@dlearn.eu
>
www.dlearn.eu
<
http://www.dlearn.eu/
>
_______________________________________________
Foss4smes-team mailing list
Foss4smes-team@lists.fsfe.org
https://lists.fsfe.org/mailman/listinfo/foss4smes-team
This mailing list is covered by the FSFE's Code of Conduct. All
participants are kindly asked to be excellent to each other:
https://fsfe.org/about/codeofconduct
--
_______________________________________________
Foss4smes-team mailing list
Foss4smes-team@lists.fsfe.org
https://lists.fsfe.org/mailman/listinfo/foss4smes-team
This mailing list is covered by the FSFE's Code of Conduct. All
participants are kindly asked to be excellent to each other:
https://fsfe.org/about/codeofconduct
| This email has been checked for viruses by Avast antivirus software.
www.avast.com |
