Fixes assert with pointers with different address spaces. We could keep looking through addrspacecast, but it would require checking for null handling of the access address space. Fixes #62384