Latest features, improvements, and product updates on Kentik's Network Observability platform.
Users will not be able to edit the Methods and Platforms sections if associated active mitigations are using them. This will prevent users from disrupting any active mitigations that are in use. Edit capability returns when mitigations are not active.
Users now have an overview of which notifications are being used and the components of the service they are notifying on
We are excited to announce support for a historical look back into your topology and metadata that will help you to monitor your cloud infrastructure more efficiently.
It is easier now to keep track of changes in your topology and metadata, such as VNETs, gateways, vWAN hubs, and Express Routes and their connections. You can use the map feature to quickly see what has changed without digging through logs or reports. It also provides a visual representation of your cloud topology at any historical moment, making it easy to spot any changes made.
We hope this new feature makes it easier for you to keep track of your cloud environment and ensure it runs smoothly. If you have any questions about Azure Cloud Map support for historical view, don't hesitate to contact our customer support team. We are here to help!
We are happy to announce the support for the Azure vWAN service in Kentik Maps and Data Explorer, with dimensions for vWAN hubs.
On Kentik Maps, vWAN components are shown in two places:
In addition, Data Explorer now has Ingress and Egress Virtual Hub dimensions that allow you to see precisely which virtual hubs were used by your traffic flow on their way to their destination.
vWAN service support will be a significant aid in troubleshooting your global cloud network deployments.
As Kentik's user base constantly increases, our engineering team is spending a proportionally increasing amount of time evaluating ways to harden the platform's security aspects.
In our ongoing quest towards SOC2 compliance, we recently increased our user password strength stance, please read on to learn more.
While this feature update is largely focused on how we now incentivize users to select stronger passwords, Kentik recommends to their security-focused users that rely in priority on stronger mechanisms than plain password auth:
Password strength is one of the more common measures to harden security around SaaS-based services - it isn't sufficient in itself, but it is necessary. Starting now, users will be required to use a password that complies to a minimum strength level, which we have decided to evaluate using a publicly accessible library named ZXCVBN:
https://github.com/dropbox/zxcvbn
Note:
Our choice for the password strength library was largely based on this article here: https://www.usenix.org/conference/usenixsecurity16/technical-sessions/presentation/wheeler
This constraint for now applies to two types of users:
This password evaluation step will show up in the login interface as displayed below
As long as the minimum password strength is not met, the [Set Password] button will be disabled and will exhibit the following alert tooltip:
Until a satisfactory password strength level is met, advice will be displayed below the input field guiding the user toward a stronger one.
This advice is based on a variety of factors such as length, variety of characters, dictionaries of common nouns used, l33tspeak…
Additionally, when resetting your password, it can not contain any of the previous 5 values, else the following will be displayed:
While dependent on the SOC2 assessor, password rotation is also one of the common demands around password security.
Therefore, the next phase will consist in having password-only users reset their passwords at regular intervals (90 days by default). We will at this point do the following:
This change should happen before April 2023 and will be additionally signaled to the impacted users in-product before being rolled out.
Today, we are adding a set of new endpoints related to various workflows in the Kentik Portal.
Read on!
The first thing to know before we get into the details is that you can always access our API sandbox from the navigation menu here:
We have recently added a set of previously unreleased endpoints to our v6 API, all can be visible at the following URLs in the portal:
These new endpoints cover three main areas of functionality:
Custom AS Groups CRUD functionality
This new endpoint set only covers the management of these AS Groups. Ongoing work is scheduled for the Data Explorer Query API to be compatible with AS Group rollups, but the release date isn't yet set.
Workflow APIs
for Capacity Planning
The set of endpoints we’ve added to Capacity Planning is for now exclusively centered around viewing either a summary of all capacity plans or details of specific plans.
for Kentik Market Intelligence
This set of API endpoints allows users to either get any ranking with any Customer-base type in any market or get customers and providers of any given network in any given local market.
Important note
The sandbox shown in the article is the one of the v6 of our API. We still have a v5 API which still covers a large amount of legacy unmigrated endpoints - the testing UI for them is located here:
https://api.kentik.com/api/tester/v5
This may not look like much, but it's big. I have been a Product Manager for more than 6 years at Kentik and when joining in 2016, I remember asking why our users couldn't give names with dots (".") and dashes ("-") when registering them in Kentik.
It wasn't easy back then but we've progressively removed all the technical hurdles to progressively enable this. (Trust me, it wasn't easy).
Today, I am very happy to announce that your device can now contain dots and dashes in their names!
As they are saying: "Great things come to those who wait"
Important note
While you can now rename all your existing devices, please be warned that any Saved Filter relying on Device Names will have to be updated accordingly to reflect any change you make to its name.
Similarly, if any dynamic Cost Group or Capacity Group relies on device naming you will also have to update them
Our CDN Analytics workflow relies on a detection engine which both takes into account your own Kentik configuration (via Interface Classification) and its constant scanning of the internet to detect IPs from CDN Servers out on the Internet. In this release, we added means for our users to help it better detect, or take into account undetected CDN caches that they are embedding in their networks.
Important note: New configuration possibilities offered by this workflow update are highly advanced - if you feel like you need to use this feature, please seek advice from your Customer Success Engineer.
Kentik enriched flow data includes src_cdn and dst_cdn fields, and these are accessible in Data Explorer as well as the namesake workflow CDN Analytics, they are also leveraged within the OTT Service Tracking workflow.
Values for these flow columns come from Kentik’s special sauce: every day a complex engine runs and evaluates multiple data-sets to map as many IPs as possible to CDNs. src_cdn and dst_cdn are then populated in flow records using this global (<IP>,<CDN>) mapping table.
CDNs can be a mix of servers either hosted on the CDN’s own network infrastructure, or inside of other networks. While servers hosted on the CDN’s own infrastructure are somewhat easy to detect, last mile embedded caches aren’t, because they’re addressed with the embedding broadband ISP’s address space.
The CDN detection engine uses a combination of the methods below, when it runs every day:
This example shows an Interface Classification Rule which will result in the associated interfaces' subnets to be picked up by the CDN detection engine and associated to a CDN.
While this approach has shown good results, some customer setups make it difficult to entirely (or sometimes correctly) detect Embedded Cache IPs. The examples below detail such corner cases.
Situation #1
Here, the interface tagged Embedded Cache is actually a /31 or /30 point-to-point subnet to connect with another Network Device on which the Embedded Caches are located, with the aggravation that this Network Device is not sending Flow Telemetry to Kentik.
In this case, two things will happen:
Situation #2
This situation is pretty similar to the previous one, with the additional complication that the interface sending flow data is not tagged as Embedded Cache by the Interface Classification rules.
In this instance above, the CDN Engine cannot detect the subnet where the cache servers are, because it doesn't have an Embedded Cache interface to pickup the subnet from.
To remedy both of the aforementioned situations, the Configuration button in the CDN Analytics workflow will allow for fine grain additional configuration.
The first tab of this configuration screen, Detected Embedded Caches, will:
To also address the situations of having caches behind non-Embedded Cache classified interfaces, and therefore undetected by the CDN Detection Engine, users have the option to manually declare CIDR blocks and assign them to CDNs, via the Additional Embedded Caches tab of this configuration screen.
Entries in this configuration section will now be picked-up with every daily run of the CDN Detection Engine and will be added to the global (<IP>,<CDN>) dataset in use by all our customers.
Bolting src_cdn and dst_cdn values into your enriched flows is not the only thing that needs to happen for your CDN Analytics workflow to display accurate data.
The workflow needs to inspect the right flow data from your Network Devices to deliver a cohesive analysis of the CDN traffic that not only enters your network, but also is generated from embedded caches within it. To do so, this workflow uses this generic filter:
As you will notice, this filter will work perfectly as long as all of the Embedded Caches in your network are connected to a router exporting flow data to Kentik. When this is not the case, the flow data to include will simply not be collected by Kentik from the interface facing the cache.
it is important to understand that mapping Cache Server IPs and selecting all the cache related flow telemetry are two aspects that need to work for the CDN Analytics workflow to display accurate results.
In the previously discussed Situation #1 and Situation #2, flows coming from the cache servers will not be considered by the filter displayed above, therefore we need ways to add these to the filter-set that regulates what flows the CDN Analytics workflow will consider.
Let's go back to Situation #2
Now we want the CDN Workflow to include traffic from the Caching Server Subnet to the data it will display in its analysis. This will be done by using the Advanced Filtering section of the CDN Analytics configuration options:
As you can see in the screenshot above, traffic from eth0/0/1 on the edge-01 network device coming from the Cache Subnet would not normally be caught by the default filter, adding it modifies the CDN Analytics behavior to include it now.
The Streaming Telemetry (ST) is now officially supported in the Kentik Portal. Users can enable Streaming Telemetry from the Device configuration dialog which is shown in the screenshot below.
This will enable Kentik Saas Ingest or Kentik kproxy to start receiving Streaming Telemetry from that Device.
The details about the configuration of the kproxy for using Streaming Telemetry can be found on the this KB article.
The status of the Straming Telemetry is shown on the Settings → Devices page with the additional “ST” flag. This flag shows the status only for devices which have ST enabled. The Streaming Telemetry status is additionally shown when the device is selected or in the Network Explorer Device Quick view page under the “More Info” Tab. Example screenshots are shown below.
At the moment, Kentik supports the following ST formats:
If a user wants to configure device to send ST directly to Kentik SaaS ingest, it should send it to port 20023. If the ST is sent to kproxy, it can be sent on any port, which is configurable as part of the kproxy configuration (a port 9555 in used Kentik’s documentation as an example).
More information about the ST can be found in our Knowledge Base:
Please let us know if you are interested to enable Streaming Telemetry from your devices and if you would like to have support for additional sensors or other Telemetry formats?
We released a new configuration knob that allows customers to change the sampling rate for AWS and Azure on their own without contacting Kentik team.
That will allow customers to consume flow logs at the preferred rate fitting into the licensing strategy, assigning priority for certain types of traffic and being flexible by changing the sampling rate at any time and separately for each flow log exporter.
Licensing will be enforced after the sampling, so customers can use heavier sampling in some cases, and saving the licensed FPS for the another S3 buckets containing flow logs.
There is a slight difference in available options for AWS and Azure.
Historically Kentik was supporting a “legacy” mode of sampling where for the large files with flow logs we were randomly picking 10,000 flow records per file in S3 bucket and ingesting only those records into Kentik Data Engine. Since the number of the flow in a file can vary this was considered an “adaptive sampling” where larger files were getting more heavily sampled comparing to the smaller files. Another option was no sampling i.e. all the records were consumed from the file.
Moving forward we now support 3 options for AWS:
Sampling rate can be configured when new flow log file is added, or changed for the existing exporter.
Flow log exporters for Azure before this release were supporting only Unsampled mode, where all the flows from the flow log file were processed by the Kentik Data Engine.
Since for some situations full flow log visibility might be not required, we added sampling knob that allows users to configure sampling rate 1:N format (meaning 1 out N records to be picked up for an ingest into Kentik Data Engine), where N should be between 2 and 2000.
