This depends on your theme. Most themes have php file called “sidebar.php”, however, other themes are more complex. There may be different sidebar files for different sidebars used in different locations. You need to figure out what file you need to edit by looking at the code of your theme.