NetFlight™ FAQ
1. Basic FAQ
1.1. What is NetFlight?
NetFlight is a revolutionary high-speed WAN transfer hardware appliance intended for high-end media workflows, and high-speed networks and storage systems.
1.2. How fast is NetFlight?
NetFlight ensures 100% error-free data transfer at stable data rates, with capabilitites in excess of 650MB/sec over 10 Gigabit WANs, even in the face of high latency or packet loss. Over Gigabit WANs it can move data at over 100MB/sec.
1.3. Under what network conditions has NetFlight been used?
NetFlight has been installed in facilities with WANs of latencies around 170ms RTT, and lab-tested at latencies in excess of 200ms RTT, and up to 1% packet loss with no breakdown points. The software can detect slow storage and will back off the transfer rate accordingly.
1.4. How does NetFlight move data so fast?
NetFlight uses a proprietary protocol that sits on IP along with intelligent buffering and optimized file system-specific interaction on the sender and receiver sides of the transfer. The proprietary protocol takes care of dropped packets by maintaining a list on both sides of the connection and retransmitting as necessary, rather than leaving it up to TCP. Intelligent buffering on either side of the connection helps to overcome latency. Optimized file system-specific interaction minimizes file system overhead, allowing NetFlight to achieve and maintain high speeds. Jumbo Ethernet frames are also utilized to achieve this performance.
1.5. What OS is running under the covers?
The NetFlight appliance runs RHEL 5.4 “under the covers”.
2. Workflow/Topology
2.1. What file types does NetFlight support?
NetFlight supports any file type.
2.2. Does NetFlight support point-to-point, one-to-many, or multicast transfers?
NetFlight currently supports point-to-point only.
2.3. Does NetFlight support real-time playback/capture?
Yes. NetFlight RT is capable of real-time playback and capture.
2.4. What does a typical deployment look like?
Typically at least one NetFlight is deployed at each end of a WAN connection. Talon also has mobile NetFlight solutions. Talon manufactures rolling flight cases with attached storage for temporary location or project-specific deployments with up to 24TB of shared SAN, called SANdeck™, or with 12TB of clustered NAS, called NASdeck™.
2.5.Is there an automated way to ensure that data on the receiving side is identical to the data on the sending side?
NetFlight has a QC post-process that compares checksums of all data sent and provides a list of any mismatches or missing files on the destination end.
2.6. What is the recovery process in the event of a fatal error?
The transfer needs to be restarted in the event of a transfer error. If necessary, it is possible to recover data from a failed transfer, but this would require intervention by a support engineer. More graceful recovery is a planned feature for Q2-2011.
2.7. How does NetFlight connect to my SAN?
NetFlight becomes a client of your SAN file system, which allows direct high-speed reads from and writes to the volumes you use to accomplish your work. Currently NetFlight supports StorNext (SNFS) shared filesystems as standard, with CXFS support as an option.
2.8. How does NetFlight connect to my NAS?
NetFlight connects to your NAS device via NFS. It supports NAS devices that are capable of presenting the same filesystem via several different ports or heads, and is capable of writing into multiple port devices simultaneously.
3. Security
3.1. Is the traffic between NetFlights encrypted?
NetFlight supports AES 256 encryption on data transfers and SSL encryption in the control connection.
3.2. How secure is the NetFlight login process?
NetFlight uses SSH2 (Secure Shell) to handle communication with the appliance via a command line. The web UI runs over HTTPS.
3.3. What ports need to be opened on intervening firewalls for the NetFlights to see each other?
This is user configurable. TCP and UDP ports 50000-50005 are used by default for communication between NetFlight systems. SSH (TCP/22) is optional for remote login.
3.4. How are users managed?
Users and groups follow UNIX standards and can be managed via command line. WebUI user management will follow sometime in mid-2011.
3.5. How do I enable users of other NetFlights to communicate with my NetFlight?
You can add them by adding their public key. This will enable two NetFlights to communicate with each other.
3.6. Is a NetFlight transfer a ‘push’ or a ‘pull’ operation?
A NetFlight transfer is typically a “push” operation, with the data transfer initiated from the server side. A trusted party at both ends is required to start the transfer.
3.7. Can I restrict a remote users’ access to storage volumes on my NetFlight?
You can by using typical UNIX permissions (user/group rwx).
3.8. Can I temporarily enable a remote user to transfer data to/from my NetFlight?
Yes, a remote user can remain disabled until you are ready to accept a transfer from them.
3.9. Can I permanently enable a remote user to transfer data to/from specific volumes on my NetFlight?
Yes, when using the GUI. When using the command line, the server process must be started before a transfer can proceed. If the server process is running, the client can initiate a transfer at their convenience.