After I upgraded to Ubuntu 17.10 I was not able to share my entire screen in Google Hangouts.
This spoiled the upgrade for me.
Fortunately the solution is quite simple: Wayland is the new default screen server and does not support fullscreen capture.
You can switch back to the XORG screen server: On the login screen click the gear Icon and select "Ubuntu on XORG".
This resolves the issue.