TL;DR - "Adjusted Gross Income" and "Adjusted Income" might be the same, but you might also be confusing the terms.
Line 4 of that worksheet states
Enter an estimate of your 2019 adjustments to income, qualified
business income deduction, and any additional standard deduction for
age or blindness (see Pub. 505 for information about these items). [emphasis mine]
I do not see "Adjusted Income" in that statement, nor elsewhere in the form. Perhaps you misread "adjustments to income"?
At any rate, "Adjusted Gross Income" (AGI) is a specific term used on your tax return that specifies the amount of income subject to Federal income tax. Usually your AGI is your total pre-tax income, minus the standard or itemized deduction amounts, and then minus any other deductions. The itemized deductions (not the income or other deductions) are included on Line 1 of the referenced worksheet.
The other deductions which make up your AGI are given on line 4. These are sometimes known as "off the top" deductions (you don't have to itemize to get them), such as Traditional IRA or HSA Contributions, student loan interest, or self-employed business expenses.
As stated above, IRS Publication 505 has details on what types of deductions can be included on line 4.
To me the Adjusted Gross Income seems to be the (sum of all income
annually minus some deductions) whereas Adjusted Income is just the
income like student loan interest etc. Can someone please clarify?
You are correct regarding "Adjusted Gross Income", but student loan interest would be called "an adjustment to income" instead. Student loan interest is not "income" but a deduction in this case.
Note that AGI is not referenced in the the W-4 form. AGI really only comes in to play when you file your return after the end of the year.