I haven't seen any issues with Hikvision cameras drifting during our testing, but we run a dedicated time server on all the Exacq machines. I've actually never tried syncing to an Exacq server without it, now that I think of it.
Can you try installing that time server (it's free) on the Exacq machine just to see if it makes a difference?
Be sure to set "Allow other computers to sync to this computer" and "Always provide time" options in the setup page, here:
So i installed this, are you guys setting this address up in the IP Camera Time Server field as well?
so time server i have 127.0.0.1
and IP CAMERRA TIME SERVER: is blank since NTP is running on the exacq box there should be no reason to bypass it correct?
just double checking how you guys have been usng this program since i have never had a need for this in the past.
Did this ever solved? I am having the same issues. It is the exacq overlay time sync that goes way out? Searching video is a mess.
I still have the issue, I have tried everything, I even set the time sync interval in the camera to sync every 90 -120 seconds and they still drift. Its very annoying.
Did you check the internal time on the cameras? Mine are fine and in sync (so the time being held in the cameras are fine). Its the overlay exacq time that is off and when you review video the searches are way off. I have this issue on a small exacq server and Large site as well. I have been working with Exacq on this with no luck. If i restart the server everything is in sync for 2 days at least! I am beyond frustrated.
Just curious, why would you leave the time onscreen on the cameras ?
Undisclosed # 3 - What on screen time are you referring to? OSD on the camera or overlay on the of the exacq?
If you are referring to the camera OSD. I didn't leave it on. I turned it on... Its purpose is to help identify what the time is on the physical camera to see what portion of the system is loosing time.
To be clear it is the overlay coming from exacq that is way off. And when you search 2 cameras in sequence to follow a subject the system displays out of sync recordings.
FYI, Exacq emailed us saying that they saw this thread and are investigating the issue.
Exacq has asked for info to be sent to firstname.lastname@example.org with subject: Case:173959 IPVM Hikvision time sync
They'd like to know:
- Jikvision firmware version
- Operating system on the exacqVision system
- Serial number of the exacqVision system (or let us know its on a third party server)
Finally, they mentioned that the Exacq test record for that Hikvision camera is here.
Undisclosed #1... Let me know how you make out. I have already spent 6+ hours on this. 1 tech says something completely different than the other and I still have no fix. I have a support case with them already so I will continue with this one.
I hope you're getting this resolved. In reading the thread I don't see anyone exactly (pun intended) ask this:
where is the primary NTP server (not some VMS camera time sync stuff, I mean a Real Network Time Server you can prove is present by using wireshark to observe the NTP traffic.)
Is the camera using the ntp server (not the vms, not "nothing"). P.s if the COMPUTER running the vms happens to also be the COMPUTER running NTP that'd be fine.
are you sure your NTP server is configured correctly. NTP servers get fussy if they don't have an outside time sync and time could start drifting.
are you sure all this video stuff (vms, onscreen camera display, tags in video, etc.) are using the NTP server time source for the time.
I have sent exacq the info as I was out of the office, but hopefully they will provide a resolution.
As far as your questions go, we have Axis cameras, and we have Hikvision cameras on the same system, the axis cameras are not missing a beat and are in sync with each other and the time server (which is local to the network, and we can communicate to it. The cameras are set to use the NVR, the firewalls are off (and have been for testing). The Hikvision cameras are off from eachother and the server by as much as 6 seconds, when you restart the exacq services and reconnect all cameras they are all synced up, but after a few days hikvision cameras are drifting. I have adjusted the time sync interval in the cameras to as low as 1 minute, and 90 minutes just to see if that would help (it didn't).
Hopefully exacq can figure it out or get us an answer.
I got a response back from exacq, they are working on it...
Thanks for the details. Our engineering team is investigating. I'll let you know when we have the answer. A couple of comments on your screen shots: I definitely see that Data Center and Main Entrance cameras are Hikvision and are off several seconds. On Tech Door, which is also Hikvision, the exacqVision time appears close to correct. If part of your concern is that the camera's timestamp is 4 hours off, that is by design. We always set the camera to UTC (EDT is UTC-4:00) and then use the server's timezone to compensate. Thus, that 4 hour offset is not indicative of an issue.
I responded that we set the hikvision time on the camera like #2 had done to prove the exacq time and camera time were different. And I also responded i knew about the 4 hour offset. Hopefully we will see what they come back with.
Norris, Inc., S. Portland, ME | 10/14/16 12:43am
I am a liitle curious as to why the time server is set to 127.0.0.1. This should be set to an accurate server, such as time.nist.gov. Check your camera to make sure it shows the actual ip address of the exacq server. Do not change any ntp settings at the camera. It must use GMT. I have seen that if you do not use an external ntp which the server can reach, like the default ntp.pool that exacq had programmed, cameras will be out of sync. I have also seen issues in the past where exacq will push a loopback address, 127.0.0.1, to the camera. This is from the network interface settings in windows, probably. If this is the case, usr the override feature with exacqvision server address. You would not be able to use cameras on a secondary nic. Make sure your dns settings and gateway are correct and working on server or this will not work. Never tried to run a NTP service on a server, and not sure why you would do this, since time will not be accurate on the system (and will drift over time).
If you have modified ntp settings on the camera, reset to default and start over. Leave camera ntp settings untouched. Make sure the server time settings are correct in windows (correct time zone) server and client.
Just wanted to add my point. This is identically what is happening to me at multiple sites. I do have one site though that is close in the time sync. This has hik cameras that have old firmware.
Norris, Inc., S. Portland, ME | 10/15/16 05:19am
if you change ntp settings on the cameras, the exacq connection will, on a regular basis, over write it if ntp is enabled. Of course I am assuming that the camera NTP feature is working from a firmware standpoint. If you say the camera has the correct dns/ip information, and ntp functions, which is drifting, the time of the camera or that of the server? (you would have to deselect the camera in exacq so it does not keep pushing itself as the ntp server, unlesd the override has an alternate fqdn or ip address of another ntp source).
As I stated before, if you manually corrected the ntp on the camera, exacq will reset it on regular intervals (back to 127.0.0.1, or to itself, which will not work to keep accurate time). If you change settings such as frame rate, codec, and quality on the camera (those that I have used), these settings will be pushed back to Exacq. Can not be certain this is the case versions 7.0-8.0.
If the camera is showing 127.0.0.1 as the ntp server, though, I assume this is the problem since Exacq is pushing this out to the camera, which is trying to reference itself for the right time. Try entering the actual ip addresd of the server in the override field in exacq, and enable. Go to the camera to see if this is now listed as the ntp server. If so, turn on the osd time on the camera, and compare to the exacq server time, lower right corner of the client.
Hello Undisclosed # 1. Has Exacq come up with a solution yet?
So the reason that your time server is set to 127.0.0.1 is that you have anti-virus on the system. What happens is that the Exacq software asks the computer for what its IP address is so it can set the cameras NTP server to that value. The anti-virus software on the PC makes it so that instead of the real IP address it returns the loopback address. This is to prevent malicious viruses and malware from finding out what your IP address is and spreading. If you go to Configure System -> Date/Time there is a field ccalled Ip Camera Time Server: and an override checkbox. Click that box and then enter the NTP server, which I am assuming is your address.
IPVMU Certified | 10/21/16 02:24pm
Have you tried getting the firmware from tech.hikvisionusa.com instead of the normal site?
So I finally heard back from exacq regarding the issue, and to my surprise there is actually an issue with the Hikvision side. I have not tested the fix, I am implementing it now on our in house system before we start sending it out the door.
The issue was traced to missing RTCP packets from Hikvision cameras. We have worked with Hikvision and they will be updating firmware to fix those versions where RTCP was not sending. In the exacqVision build linked below, the exacqVision server will detect when RTCP packets are missing and compensate by using the server time. Please let me know if this resolves your issue. This is planned for inclusion in our Dec 2016 release.
PS - chose the link appropriate for your platform - Windows 32 bit, Windows 64 bit, or Ubuntu.
Windows 64 bit:
Dan Rittman / Sr Director of Engineering / Tyco Security
So UD#2, if you want to give those links a shot, see if that helps you out, and i am going to do the same.
Thanks so much UD 1. I have spent countless hours on this and I was run around the block and back and starting to loose faith. I hope this works.
I just wanted to give a quick update, we installed the updated server on our in house box, and the cameras have held tight for a couple of days now, down to the second, so I am going to say problem soled. #2 how did you come out on your end?
I just installed on my first site. Only been installed for 1 hour so I will keep you posted.