This paper proposes an authentication scheme based on fragile watermarking as well as a copyright protection (CP) scheme based on non-blind watermarking for H.264/AVC and SVC. The proposed authentication scheme uses the intra prediction modes and the inter prediction modes which are optimized for blocks as watermark for authentication, and the watermark thus generated is embedded into the quantized coefficients that satisfy a given condition. This scheme offers low running time in the H.264 encoding/decoding process, but it has a little increased ratio permissible in the bit-rate. The proposed CP scheme inserts a watermark of the owner into the DCT domain of I-frames that are divided into 4 × 4 blocks of uncompressed content. Our CP scheme provides robust watermark not only in the content to which fragile watermarking is applied but also in the content which is re-encoded and modified as intended. Moreover, the proposed Authentication and Copyright Protection Scheme offers low computational complexity as well as low degradation of video quality.