According to wiki, The term jay-walking originated in the United States as a derivation of the phrase Jay-driver, referring to people who drove horse-drawn carriages and automobiles on the wrong side of the road. You are right about the “jay” part which is a derogatory term referring to the stereotype of unsophisticated country people.