It wont damage it but can stop it working properly or worse make it work when you dont want it to for example.
Your rolling radius for the wheels is going to be quite different and your front wheels will be turning at a diferent speed to the backs.
Not to mention probably looks bizzare.