Thanks for the follow-up @Courtney3,
All ORG members are visible in the Assignee field, so in order to remove them from there, you must completely remove these members from your Org.
Customers often tend to skip steps 6 & 7, which results in members being removed from the Team but not from the Organization, and still show in the assignee field 