An EP consisting of foreign b-sides, some new songs and other hard to find songs was released in 1991, appropriately entitled Attack of the Killer B's. Many people consider it a full length album though, because most EP's don't last over 44 minutes. But as it says inside, it is the "longest EP ever." Another rap/metal crossover was made with Anthrax and members of Public Enemy. The song was "Bring the Noise," originally "Don't Believe the Hype" by Public Enemy. The song was made metal with the heavy riffs and drum rolls Anthrax added, but was still rap. Charlie explains "the music that I've always loved has been the old Led Zeppelin and Black Sabbath and if you listen to those bands, they're very drum driven. The heart and soul of those bands has always been the beats and one thing the rappers used to say to us is that Led Zeppelin, Aerosmith have always got the great beats. That old metal was the heaviest stuff at the time. When we started playing, it was like the Rappers had captured that feeling so we wanted to work with the best of them who for us was Chuck D and Public Enemy." A single was released for the song, and a video was made. This EP really shows the schism developing between Joey and the rest of the band, as he didn't do much of the singing on the album. Most of the "singing" on the heavier songs is done by Scott.

As explained before, this EP was meant to compile some of the Anthrax songs that were harder to find. But many people also say this EP was done to help fulfill Anthrax's contract with Island Records, who were not doing a very decent job managing and promoting Anthrax.

Attack of the Killer Videos was released, which featured two versions of "Bring the Noise" and "Belly of the Beast"(live).

After its release, Anthrax did a genre shattering co-headlining tour with Public Enemy. Primus and Young Black Teens (YBT) were the opening bands. It was appropriately called the Live Noize tour. At the end of each show, Public Enemy joined Anthrax on stage for the songs "Too Much Posse"(originally by Public Enemy) and "Bring the Noise." One of these great shows, recorded at Irvine Meadows, California, was released as Anthrax's fourth home video, Live Noize.

After that, they continued touring, because that is what they like to do. They signed a new record deal with Elektra records, who had experienced multi-platinum success with Metallica in the past years. By the time the contract was signed in March, Joey was fired from the band. It was the night of the Grammies. (Attack of the Killer B's had been nominated for a Grammy.) The band did not speak to Joey the whole night. When he got home, he found a message on his answering machine from Johnny Z saying he had been fired. Musical differences were the sole reason for his dismissal. "A lot of people seem to think (the split with Joey) had to do with personal differences, and it wasn't that at all," explains Scott. "It was strictly creative. The guy had no input into the band at all—by his own doing! I used to think I would like it that way, because it gave me more control. I didn't. What it really came down to is me asking myself if someone's not putting much of themselves into a band, what's the performance going to be like?"

Scott and Charlie reformed S.O.D. for one show at the Ritz in New York with Agnostic Front and Morbid Angel opening. The show was released and entitled Live At Budokan. It came out as a CD and video.