Incorporate Peter's feedback
This commit is contained in:
parent
d94a9f78fb
commit
92f6138ebf
3 changed files with 42 additions and 250 deletions
31
rebuttal.md
31
rebuttal.md
|
@ -1,10 +1,12 @@
|
|||
# Rebuttal
|
||||
|
||||
## Common remarks
|
||||
To view the actual changes made in response to the comments, see the version of the PhD that shows the difference with the version submitted in March.
|
||||
|
||||
## Recurring remarks
|
||||
|
||||
> The global research question should be more clearly stated in the text. This should also help with connecting the two parts of the dissertation.
|
||||
|
||||
The section "Structure of this dissertation" has been edited to explicitly mention a global research question, and a research question for each chapter.
|
||||
The section "Structure of this dissertation" in the introduction has been edited to explicitly mention a global research question, and a research question for each chapter.
|
||||
|
||||
> There should be more focus on the lessons learned when building an assessment platform like Dodona.
|
||||
|
||||
|
@ -12,11 +14,17 @@ By adding a research question and conclusion to chapters 2, 3, and 4, this remar
|
|||
|
||||
> Chapter 6 is of lower quality than the rest of the chapters.
|
||||
|
||||
The work on the included article was continued after the dissertation was submitted, and that article has now been submitted to the Journal of Artificial Intelligence in Education. This version of the article is now included, which should solve the remarks on this chapter.
|
||||
The work on the included article was continued after the dissertation was submitted, and that article has now been submitted to the Journal of Artificial Intelligence in Education (currently under review).
|
||||
The submitted version of the article is now included, which should solve the remarks on this chapter.
|
||||
In addition to textual improvements, the accuracy and the performance of the model have also been improved.
|
||||
|
||||
> It would be good to compare Dodona and other modern platforms, perhaps via a comparative table.
|
||||
|
||||
This comparative table has already been created by Sven Strickroth at https://systemscorpus.strickroth.net/. I tried including a selection from this table in the dissertation, but found it did not add much to the text.
|
||||
Such comparative table has already been created by Sven Strickroth at https://systemscorpus.strickroth.net/.
|
||||
I tried including a selection from this table in the dissertation, but found it did not add much to the text.
|
||||
As a result, I finally decided not to include such a table.
|
||||
In general, a comparison should not merely be done based on the major features of most platforms (as most platforms share more ore less the same features).
|
||||
Differences appear in the detailed ways these features are implemented, which require a much more in-depth discussion than simply a comparative table.
|
||||
|
||||
> The final chapter is short and could be expanded upon.
|
||||
|
||||
|
@ -74,13 +82,17 @@ This suggestion was applied.
|
|||
|
||||
> It may be useful to include an appendix with an example that illustrates the templating system adopted by TESTed.
|
||||
|
||||
While this would be interesting, TESTed is not the main focus of this PhD. For more detail on this, I would like to refer to the PhD of my friend and colleague Niko Strijbol, which goes much more in detail on TESTed.
|
||||
While this would be interesting, TESTed is not the main focus of this PhD.
|
||||
For more detail on this, I would like to refer to the PhD of my friend and colleague Niko Strijbol, which goes much more in detail on TESTed.
|
||||
It is also discussed in detail in an article that is currently under review (Strijbol et. al, 2024).
|
||||
|
||||
### Chapter 5
|
||||
|
||||
> The fact that the fourth series is an exception can perhaps also be attributed to students facing the combined use of conditional and repetitive execution for the first time, which challenges their skills in terms of keeping track of the flow of execution.
|
||||
|
||||
While true that this is challenging for students, most exercises in the third series (while repetitive execution is introduced) also contain conditional execution. Therefore I did not change the text related to this.
|
||||
While true that this is challenging for students, most exercises in the third series (while repetitive execution is introduced) also contain conditional execution.
|
||||
What is definitely new in the fourth series are nested loops, which challenges the students.
|
||||
Therefore I did not change the text related to this.
|
||||
|
||||
## Frank Neven
|
||||
|
||||
|
@ -94,7 +106,10 @@ This has been done.
|
|||
|
||||
> In the list of publications on pages ix and x it is not very clear what the difference between the different publications is (1 and 6, 2 and 8, 4 and 5). Some seem to have the same title but published elsewhere? Is it really a different publication then?
|
||||
|
||||
Some of these were publications of conference posters; these have been removed. The others are in fact different publications.
|
||||
Number 5 was the publication of a conference poster; this has been removed.
|
||||
The others are in fact different publications.
|
||||
1 and 6 are two publications on TESTed, but on very different aspects of it.
|
||||
2 and 8 are two publications on Dolos, but also present different aspects of it.
|
||||
|
||||
> In chapter 4 before explaining all implementation choices and details of TESTed in section 4.4 maybe first show a motivating example first to keep the reader's attention. (For example the example of Listing 4.5 could come much earlier.)
|
||||
|
||||
|
@ -111,11 +126,13 @@ The mathematics has been taken out of the running text and placed in its own env
|
|||
> LLMs are becoming more important, and the possible link with auto-graders is clear. You do mention them to some extent in chapters 6 and 7 but a slightly more thorough section on that would have been preferable. (This remark is a suggestion and not a blocking factor.)
|
||||
|
||||
The possibilities for future work have been expanded upon in the final chapter, including the LLM sections.
|
||||
This will also be the focus of the PhD of a new PhD student joining Team Dodona in September, Thomas Van Mullem.
|
||||
|
||||
## Rajia Hämäläinen
|
||||
|
||||
> The differences and similarities between learning analytics and educational data mining could be more clearly described, both theoretically and in the practical section.
|
||||
|
||||
This was indeed an oversight.
|
||||
Definitions of LA and EDM have been added to the introduction to make clear what is meant by these terms in this PhD.
|
||||
|
||||
> It would be interesting to know more about the division of labor between Van Petegem and the rest of the Dodona team.
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue