get exception if i delete from main table where foreign key relationship exists ??

I have a SQL database with 10 tables.

The main table "Artist" has foreign key relationship with 7 of the other tables
ArtistId - is the primary key of type GUID - unique identifier and this exists in the other tables as FK

if I try to delete a row from Artist table  -then i get exception
The DELETE statement conflicted with the REFERENCE constraint "FK_xxxxxxxxxxxx_Country". The conflict occurred in database "xxxxxxxxxxx", table "dbo.xxxxxxxxxx", column 'ArtistId'. The statement has been terminated.
How can I remove all the rows from all the tables that correspond with Same "ArtistId" that I am trying to delete

thank you