According to reports from Edge users, the icon appeared after updating Edge to version 121.0.2277.128, and can be seen in the top-right corner of the screen, just below the Close (x) box.

Turn off the Always show scrollbars setting. After this, the scrollbars will disappear automatically when not in use and you will need to use the Up/Down arrow keys to show the scrollbar for using it.