Welcome to the Asana Community Forum @Sheena_Hawkins!
Yeah currently you cannot really control custom fields in somebody’s My Task list.
Have a look at the discussion here as this basically applies to custom fields in My Tasks in general not only the priority field.