If you live in an enhanced smog check county (where your car is required to be driven on a dynamometer during the smog check) then yes, your vehicle will not pass the smog test if the smog technician is unable to maintain correct MPH to RPM parameters. More than likely the smog test will be aborted before it is completed, or the technician will simply refuse to smog test the car.
In a non-enhanced smog check county (where the smog test is only conducted during Idle and 2500 RPMS) more than likely the transmission problem will not cause a smog check failure, so long as the check engine light or service engine soon light is not illuminated.
Use the link below to find out which type of smog check county your vehicle is registered in:
http://smogcheck.ca.gov/pubwebquery/Ziparea/ZipLookup.aspx
