Whats the difference between air soft guns and bb guns?

I've heard its the ammo, that bb guns use copper or harder metallic bbs and air soft use plastic. Does that mean if I were to replace my plastic bb's for my air soft gun with metal ones, it would hit harder?