The problem here is that you want to get all the events of all structure fields and then sort them.
-
question: if there is only one event per page, why do you use a structure field for it instead of just two standard fields?
-
to achieve what you want with your current setup, you would have to create a structure field from all structure field of all pages. See this post for an example how to achieve this.