The S&P 500 does not include dividends. You should check the S&P 500 Total Return Index.
The average annual total return of the index, including dividends, since inception in 1926 has been 9.8%
This would give you roughly 5.2% annual real return, looking much better.
However, this is in USD. Apparently, one GPB was worth ...