Knowledge Base

 
Reset Search
 

 

Article

NCOS: Troubleshooting Tools

« Go Back

Information

 
Content

NCOS: Troubleshooting Tools

Products Supported: AER31x0, AER21x0, MBR1400, MBR1200B, CBA850, CBA750B, IBR11x0, IBR6x0, IBR350. Click here to identify your router.

NCOS Version: 6.0 or later - for information on upgrading NCOS, click here.


Quick Links

Summary

GUI Tools

CLI Tools

Status

Specific Logging

Informational

Testing

Related Articles


Summary

This article provides a summary of useful tools and commands found within the GUI and the CLI of CradlePoint routers for the purpose of determining the cause and finding resolution of issues experienced with Series 3 routers on NCOS 6 or later.


GUI Tools

Configuration Difficulty: Intermediate

Much of the information necessary for troubleshooting can be obtained directly from the NCOS GUI (graphical user interface), commonly referred to as "administrative pages".

To access troubleshooting tools available in the router's GUI, follow the steps listed below:

  • Step 1: Log into the router's Setup Page. For help with logging in please click here.
  • Step 2: Continue to follow the instructions listed below for accessing specific information.

Standard Router Log

  • Step 1: Click on the STATUS tab and select System Logs.
  • Step 2: Choose a method to review router activity:
    • Click Save Log to generate a text file with logging information. This option is useful when someone else needs to review the logged data, or current router events will need to be compared with another log at a later date.
    • Place a check next to Auto Update to tell the router to update the log with new events as they occur. This option is best used when reviewing router activity in real time.
    • Click Update to refresh the log to display new events since the page was loaded or last refreshed. This option is useful when events occur quicker than log entries can be read.
  • Step 3: Review our Router Log feature article for additional tips and tricks for using the standard router log.

User-added image

Support Log

The router Support Log bundles the system logs and some information about the current router configuration in a single file. This type of log is extremely helpful in troubleshooting issues after the fact because it provides a snapshot of what the router was doing at the time the problems occurred.

To generate the router Support Log, follow the steps listed below:

  • Step 1: Click on the SYSTEM tab, select Administration, and select System Logging.
  • Step 2: Click Save to disk next to Create support log to generate a new text file.
  • Step 3: Save the file to your computer, then send it as an email attachment to a Cradlepoint support representative for review.

User-added image

Debug Logging Level

At the DEBUG logging level, there is the possibility of over 1000 different new messages showing up in the router's log, depending on the services being used by the Cradlepoint router. It often helps to enable this option for a short time to get additional data during advanced troubleshooting.

Note: Using this logging level will impact router performance and over time can cause unexpected reboots or loss of functionality. This option should only be enabled at the request of an authorized Cradlepoint representative, and is recommended to be immediately be disabled after necessary logging information has been collected.

  • Step 1: Click on the SYSTEM tab, select Administration, and select System Logging.
  • Step 2: Click the drop-down arrow next to Logging Level and select DEBUG.

Note: Existing system logs will be unaffected by this change. Only events that occur after the change was made will trigger debug level messages.

User-added image

Verbose Modem Logging

Enabling any level of Verbose Modem Logging will write additional messages to the router's system logs regarding modem activity. This option is useful when there are problems with WAN connectivity. The types and amounts of messages you will see will depend on the modem you have connected and the modem's compatibility with the function. It often helps to enable this option for a short time to get additional data during advanced troubleshooting.

Note: Using this logging level will impact router performance and over time can cause unexpected reboots or loss of functionality. This option should only be enabled at the request of an authorized Cradlepoint representative, and is recommended to be immediately be disabled after necessary logging information has been collected.

  • Step 1: Click on the SYSTEM tab, select Administration, and select System Logging.
  • Step 2: Click the Level dropdown button next to Verbose modem logging.
  • Step 3: Select one or more options from the list of Error, Warn, or Info, as instructed by a Cradlepoint support representative.

Note: Existing system logs will be unaffected by this change. Only events that occur after the change was made will trigger debug level messages.

User-added image


CLI Tools

Configuration Difficulty: Expert

The command line interface of Cradlepoint routers offers commands that allow us to drill down to troubleshoot specific functions within the router.

To use the CLI, you will need to connect a client device to the Cradlepoint via SSH. Please refer to this article for specific instructions for enabling and using SSH with CradlePoint routers. Note: you can also use the CLI from the admin pages by going to System > System Control > Device Options and clicking the Device Console button

User-added image

The CLI of the Cradlepoint is separated in to “trees”. One of these trees it the “Status” tree. The Status tree allows you to see the the status of functions within the Cradlepoint similar to what you are able to see in the GUI. However, there are a few commands that you can use in the CLI to see statuses that are not available in the GUI.

Status

Router Statistics (Data from the STATUS > Internet > Statistics page in the router's GUI):

  • usage (in bytes/second): get /status/stats/usage
  • rf (measured in dBm): get /status/stats/rf
  • failover: get /status/stats/failover

Product Info: get /status/product_info

LAN statistics: get /status/lan/stats

WAN statistics: get /status/wan/stats

Load Average (Average CPU utilization for the last 1, 5, and 15 minutes): get /status/system/load_avg

Memory Status: get /status/system/memory

Hotspot Status: get /status/hotspot

Specific Logging

These commands when increase logging for certain features within the Cradlepoint. These additional log entries will appear in the System Log in both the CLI and the GUI.

Note: Enabling additional levels of logging will impact router performance and over time can cause unexpected reboots or loss of functionality and should only be enabled at the request of an authorized Cradlepoint representative.

RADIUS: set /config/wlan/radius_verbosity 10 (any number between 1-10, the default is 6)

WLAN: set /config/wlan/wlan_verbosity 10 (any number between 1-10, the default is 6)

VPN: set /config/vpn/debug true

Routing Protocols

  • rip: set /config/rip/debug true
  • ripng- rip for ipv6: set /config/ripng/debug true
  • bgp: set /config/bgp/debug true
  • ospf: set /config/ospf/debug true

Web Filter: set /config/webfilter/logaccess true

Informational

SupportQA: This is a script that will issue preset commands in order to provide data for troubleshooting. The script will issue the following commands, for a definition of each command please refer to the appropriate command definition in this document.
f=resources()\nprint(f)\nf=threads(v=True)\nprint(f)\nf=devices()\nprint(f)\nf=lan()\nprint(f)\ nf=netfilter()\nprint(f)\nf=route()\nprint(f)\nf=wan()\nprint(f)\nf=wireless(v=True)\nprint(f)\nf=workqueue()\ nprint(f)\nf=get()\nprint(f)\n

diff: Show differences between the current configuration and the default configuration.

log: Show and manipulate the log system.

log [show|clear|level|msg] [SUBOPTONS...]
show [FILTER] [FILTERN] [[-bhi] -s SEARCH]

USAGE:

  • FILTER can be one or more space-separated names or levels, e.g., log show wanmgr kernel DEBUG INFO
  • -b: bold new entries
  • -h HIGHLIGHT: same usage as searching but does not filter results
  • -i: makes the search case insensitive
  • -s SEARCH: can be any string to search for in the log message contents, e.g., log show -s Firmware
  • -f [LINES_OF_HISTORY]: follow mode with optional argument for number of lines of history to show
  • clear: erase all logs from memory
  • level [NEW_LEVEL]: view current level or set new log level to: critical, error, warning, info, or debug
  • msg [-l LEVEL] MESSAGE: write a message to the logging system; LEVEL defaults to Info

route: The route command can be used to show the current routing tables as well as make changes to the user defined static routing table.
NOTE: Only the user defined static routing table may be modified directly.

route [-v]
route add 172.0.0.100 dev lan
route add 10.0.0.0 netmask 255.0.0.0 gw 172.0.0.100

USAGE:

  • route add IP [netmask NM] [gw IP] [dev UID]: add new user defined static route
  • route del IP [netmask NM] [gw IP] [dev UID]: remove user defined static route(s)
  • -v: verbose output

arpdump: The arpdump command shows the current arp table.

switch: Show ethernet switch status.

switch [-v] [show|set|clearstats]

USAGE:

  • show [port PORT_NUM]: only show the port specified
  • set PORT_NUM
  • [--mode=MODE]
    • [--gid=GROUP_ID]
    • [--link_speed=LINK_SPD]
    • [--mac=LINK_ADDR]
    • [--mode=MODE]
  • clearstats [PORT_NUM]

tcpdump: Is a common packet analyzer that runs under the command line. It allows the user to intercept and display TCP/IP and other packets being transmitted or received over a network to which the computer is attached.

tcpdump [-aAdDeflLnNOpqRStuvxX] [-c count] [-E algo:secret] [-i interface] [-M secret] [-s snaplen] [-T type] [-y datalinktype] [expression]

wireless: Show the current wireless configuration and status.

wireless [OPTIONS...]

USAGE:

  • -w: Print information about enabled Access Point profiles
  • -d: Print information about enabled WiFi as WAN / WiFi Bridge profiles
  • -c: Print information about currently associated WiFi clients
  • -v: Print additional driver specific debug when available
  • -t [CHANNEL]: Set wireless channel
  • -k [MAC ADDRESS]: Kick wireless client
  • -s [OPTIONAL DWELL TIME]: Perform a wireless survey
  • -a [OPTIONAL DWELL TIME]: Do a survey and autoselect a channel
  • -r [RADIO]: Radio to operate on (0: first, 1: second)

workqueue: Print current workqueue activities and schedules.

workqueue [-v] [-t TASKID] [-a] [monitor]

USAGE:

  • -v: VERBOSE
  • -t TASKID: Only show information for a single task
  • -a: Show information for active tasks (ie. currently - executing)

atterm: The atterm command can be used to get direct access to a modem's AT command channel. If a modem interface is not given then the system will pick the highest priority modem. To discover a modem's interface to use, use the command 'devices' and the value found under the 'SubIface' column.

atterm [interface] [-c ATCMD] [-t SOCKET_TIMEOUT]

threads: Show currently active threads.

devices: Display network devices connected to the router.

devices [-v]

USAGE:

  • devices [-v] [DEVICE_UID...]: Show one or more specific devices.
  • -v: Verbose output

help: Get help with a specific command, e.g., help CMD.

netfilter: Show info and debug from netfilter2 rule(s) and trigger(s).

netfilter [active|all|upnp|triggers|states] [input|routed|output] [ip/ip6] [-v] [-s] [-r RULE_INDEX] [-t TRIGGER_INDEX] [-s TATE_INDEX]

uptime: Show system uptime and load average.

inspect: Inspect a directory.

resources: Report the system resource usage.

ecm: Manage connection to the Cradlepoint Enterprise Cloud Manager.

ecm [alert|status|register|stop|start|restart|triggers]

USAGE:

  • status: [DEFAULT] Show current status information.
  • register [--username=USER --password=PW]|[--token_id=TID --token_secret=TS]: (Re)register
    • --username: The ECM username that should be used to authenticate.
    • --password: The ECM password that should be used to authenticate.
    • --token_id: [EXPERT] Token ID for token authentication mode.
    • --token_secret: [EXPERT] Token secret for token authentication mode.
  • unregister: Unregister this router from ECM and unregister.
  • stop: Manually stop the ECM client.
  • start: Manually start the ECM client.
  • restart: Manually restart the ECM client.

Example:

State: Connected
Connected: 5:38:31
Router ID: 46697
Data Usage Input: 1.03M
Data Usage Output: 1.24M
Data Usage Period: 15 days, 15:07:03
Data Usage Monthly Estimate: 4.36M
Config Sync Status: ready
Recent Activity:
5:38:31 ago: Remote config read triggered
5:38:31 ago: Remote stream_client heartbeat triggered
5:38:31 ago: Remote config read triggered
5:38:31 ago: Remote config read of differences from default triggered
5:38:31 ago: Remote status read triggered

Testing

ping: Send a ICMP echo request to a remote computer
ping [-w DEADLINE] [-c COUNT] [-i INTERVAL] [-s SIZE] [-I SOURCE] HOSTNAME

ping6: Send a ICMPv6 echo request to a remote computer
ping6 [-w DEADLINE] [-c COUNT] [-i INTERVAL] [-s SIZE] HOSTNAME

traceroute: Trace the route to HOST
traceroute [-FIldnrv] [-f 1ST_TTL] [-m MAXTTL] [-p PORT] [-q PROBES] [-s SRC_IP] [-t TOS] [-w WAIT_SEC] [-g GATEWAY] [-i IFACE] [-z PAUSE_MSEC] HOST [BYTES]

  • -F: Set the don't fragment bit
  • -I: Use ICMP ECHO instead of UDP datagrams
  • -l: Display the TTL value of the returned packet
  • -d: Set SO_DEBUG options to socket
  • -n: Print numeric addresses
  • -r: Bypass routing tables, send directly to HOST
  • -v: Verbose
  • -m: Max time-to-live (max number of hops)
  • -p: Base UDP port number used in probes (default 33434)
  • -q: Number of probes per TTL (default 3)
  • -s: IP address to use as the source address
  • -t: Type-of-service in probe packets (default 0)
  • -w: Time in seconds to wait for a response (default 3)
  • -g: Loose source route gateway (8 max)

Related Articles/Links


Published Date: 9/14/2015

This article not have what you need?  Not find what you were looking for?  Think this article can be improved?  Please let us know at suggestions@cradlepoint.com.

Feedback

 

Was this article helpful?


   

Feedback

Please tell us how we can make this article more useful.

Characters Remaining: 255