When administering letter sounds, do students need to say the short and/or long vowel sound(s)?

You can actually make the call. What you decide should be consistent with your instruction.

To be most valid, the assessments should be administered and scored with the same expectations as what is being taught. If you allow them to make certain sounds in their learning process then please do so when administering our measures.