Purpose
Evaluate the current performance of this first version of the intrusion detection algorithm, deployed on the nami mesh, in detecting motion attributable to humans.
There are two key performance indicators:
- The average time of first human classification from any of the links in a mesh topology
- The average number of false positives
Test Plan Assumptions
- All nami devices are correctly installed and configured according to pre-conceived guidelines
- Each nami device is connected to a stable and reliable power source.
- Each nami device is connected to the internet during the duration of the tests.
- Testers have access to the test interface in the nami app
- The testing environment accurately simulates real-world home intrusion scenarios.
Active Testing: Mock intrusions
Repeat and document as necessary the following steps no less than x5 times for each movement pattern.
Testing tip: Although not required, starting each test on a new minute is recommended. E.g., open the door to enter the sensing space at exactly 12:30:00.
Test procedure
- Exit home and allow 1 minute of empty time within the sensing space.
- Note down the time to the second.
- Open the front door and move inside the presumed sensing zone, closing the front door behind
- Without stopping for 2 minutes, continuously move to each room that contains a receiver, one after the other, and back to the front door. Reverse direction when returning to the point of entry.
- Following 2 minutes of activity, open the front door and walk outside the home, again closing the door behind.
- Note the time to the second the door was closed.
Passive Testing: False alarm performance
Assumptions
- Testers strictly adhere to leaving the home when pet-alone time is in effect. Isolation of pets is insufficient and can contaminate test results.
- No robotic vacuums (E.g., iRobots), or oscillating / rotating fans are moving during pet-alone time.
Testing recommendation: Pet-alone time must be 2 hours or longer each day. Document the time an in-door pet is left alone each day.
Test procedure
- Open the front door and exit the home. Use the most common point of entry.
- Note the exact time the entry-point door was closed to the second.
- Leave pet(s) unattended inside the home for at least 2 hours.
- Following 2 hours or more of pet-alone time, return home.
- Note the exact time of entry to the home (I.e., the exact time the entry point door was opened) down to the second.