I have done this test already. A new simple app is created with a new app ID. So, certificate for this new app ID is created again. The only reason for the failure is production certificate.
When I submit the app to beta testing in iTunes connect, I make sure that team release certificate and production provisioning profile with prefix "XC :" are used. In contrast, development push certificate in beta testing release method has no problem. In this case, developer release certificate and development provisioning profile are used. Thus, I knew the procedure I have done are correct.
Since there is no error in any steps except the action carried by apple server to iOS device. I have no idea how to figure out the root cause. I have read "trouble shooting for push notification" in Apple technical document to use iOS console to make sure the data link in the device is functional. What can I do?